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Director's  Foreword 


The  US  Army  Research  Laboratory  (ARL)  mission  is  to  “provide  innovative 
science,  technology,  and  analyses  to  enable  full  spectrum  operations.”  As  the 
Army’s  corporate  laboratory,  we  provide  the  technological  underpinnings  critical 
to  providing  capabilities  required  by  our  current  and  future  Soldiers. 

Our  nation  is  projected  to  experience  a  shortage  of  scientists  and  engineers.  ARL 
recognizes  the  criticality  of  intellectual  capital  in  generating  capabilities  for  the 
Army.  As  the  Army’s  corporate  laboratory,  addressing  the  projected  shortfall  is  a 
key  responsibility  for  us.  We  have,  therefore,  identified  the  nation’s  next  generation 
of  scientists  and  engineers  as  a  key  community  of  interest  and  have  generated  a 
robust  educational  outreach  program  to  strengthen  and  support  them.  We  have 
achieved  many  successes  with  this  community.  We  believe  that  the  breadth  and 
depth  of  our  outreach  programs  will  have  a  significant  positive  effect  on  the 
participants,  facilitating  their  journey  toward  becoming  this  Nation’s  next 
generation  of  scientists  and  engineers. 

A  fundamental  component  of  our  outreach  program  is  to  provide  students  with 
summer  research  experiences.  During  the  summer  of  2017,  ARL  hosted  more  than 
170  undergraduate  and  graduate  students.  Many  of  these  students  chose  to 
participate  in  directorate-level  competitions  with  the  goal  of  being  selected  as  a 
directorate  finalist  and  competing  at  the  ARL-wide  Summer  Student  Symposium; 
others  participated  in  the  symposium  by  presenting  posters.  I  applaud  symposium 
participants  and  all  summer  interns  who  contributed  to  the  ARL  mission. 

We  are  very  pleased  to  have  hosted  this  outstanding  group  of  students  for  the 
summer.  It  is  our  hope  that  they  will  continue  their  pursuit  of  technical  degrees  and 
will  someday  assist  us  in  providing  critical  technologies  for  our  Soldiers. 


Philip  Perconti 
Director 
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Introduction 


The  ARL  Summer  Student  Research  Symposium  is  an  ARL  Director’s  Award 
Program  for  students  participating  in  various  summer  internship  opportunities 
across  ARL.  The  goal  of  the  program  is  to  recognize  and  publicize  exceptional 
achievements  made  by  the  students  and  their  mentors  in  the  support  of  Army 
science. 

All  undergraduate  and  graduate  interns  are  eligible  to  compete  for  a  finalist  position 
and  give  an  oral  presentation  at  the  symposium.  All  students,  including  high 
schoolers  in  the  Science  and  Engineering  Apprentice  Program  (SEAP),  are 
encouraged  to  present  posters  at  the  symposium  and  submit  abstracts  summarizing 
their  accomplishments. 

Oral  presentations  at  the  symposium  are  given  by  finalists  selected  based  on 
directorate-level  competitions.  Each  directorate  can  send  one  graduate  student  and 
one  undergraduate  finalist  to  the  symposium.  The  Sensors  and  Electron  Devices 
Directorate  and  Weapons  and  Materials  Research  Directorate  have  relatively  large 
numbers  of  interns  and  can  each  send  2  undergrad  finalists. 

This  year’s  symposium  was  held  at  the  Mallette  Center  at  Aberdeen  Proving 
Ground,  Maryland,  on  Thursday,  10  August  2017.  Oral  presentations  were  judged 
by  a  panel  of  senior  ARL  scientists  (including  ARL  Fellows  and  Chief  Scientists). 
Students  with  the  top  3  presentations  (“Corporate  Medalists”)  were  awarded  the 
ARL  Summer  Student  Research  Gold  ($500),  Silver  ($300),  and  Bronze  ($200) 
awards  in  the  undergraduate  and  graduate  student  levels. 

This  volume  of  the  Summer  Student  Symposium  Proceedings  contains 
presentations  given  by  all  directorate  finalists  at  the  symposium.  Volume  II  (ARL- 
SR-0388)  is  a  compendium  of  student  abstracts. 
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2017  ARL  Summer  Student  Symposium  Agenda 


0700 

0820 

0830-0840 

0840-1130 


1130-1215 

1215-1420 


1420-1455 

1450-1515 

1530 

1645 


10  August  2017 

Mallette  Training  Center  Auditorium  (B6008) 
Aberdeen  Proving  Ground,  MD 

Bus  departs  ALC 
Bus  arrives  from  ALC 

Welcome 


Undergraduate  Presentations  (Auditorium) 

Robust  Adaptive  Control  of  Unmanned  Aerial  Systems  (UAS) 

Dynamic  Occlusion  Culling  in  VR 

Fabrication  &  Characterization  of  Silicon  Nanoparticles  for  Energetic 
Applications 

Ultra-Low-Power  Sensing  &  Processing 

A  Comparison  Study  of  Carbon  Polymer  Electrodes  for 
Electroencephalography  (EEG)  Recording 

Collision  Avoidance  Robot  Using  Neuromorphic  Hardware 

High-Strain  Rate  Hardness  of  Tungsten  Carbides 

Effect  of  B:B203  on  Reactive  Hot-Pressing  of  Boron  Suboxide" 

Lunch  +  poster  session  (Room  10B) 

Deliberations  (Undergrad  category)  by  Review  Panel 

Graduate  Presentations  (Auditorium) 

A  physical  Manifestation  of  Dynamic  Scaling  Laws 
Limits  of  Subpixel  Motion  Detection  with  a  Video  Camera 
The  Effect  of  Imperceptible  Noise  Stimulation  on  the  Spinal  Reflex 
Solving  Vertex  Cover  Via  Using  Spin  Model  On  Neuromorphic  Processor 
Modeling  RDX  Decomposition  Products  with  Mesoscale  Particles 
Visualization  of  Human  Vulnerability  in  VR 


Refreshments  +  poster  session  (Room  10B) 
Deliberations  (Graduate  category)  by  Review  Panel 

Awards  Ceremony 

Bus  departs  for  ALC 
Bus  arrives  at  ALC 
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Dr.  Rose  Pesce-Rodriguez 

Blake  Anderson  (VTD) 

Ben  Kolarik  (SLAD) 

Sarah  Adams  (SEDD) 

Peter  Deaville  (SEDD) 

Christina  Nguyen  (HRED) 

Clarence  Wong  (CISD) 

LukeHanner  (WMRD) 

Howard  Payne  (WMRD) 

All 

Daniel  Blackman  (VTD) 

Minas  Benyamin  (SEDD) 
Maxwell  Alander  (HRED) 
Kevin  Corder  (CISD) 

James  (Matt)  Mansell  (WMRD) 
Tiffany  Raber  SLAD 

All 
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2017  ARL  Summer  Student  Symposium 


Undergraduate  category  winners 
Gold  Medalist: 

Sarah  Adams,  Sensors  and  Electron  Devices  Directorate 
Fabrication  &  Characterization  of  Silicon  Nanoparticles  for  Energetic 
Applications 

Silver  Medalist: 

Peter  Deaville,  Sensors  and  Electron  Devices  Directorate, 

Ultra-Low-Power  Sensing  &  Processing 

Bronze  Medalist: 

Luke  Hanner,  Weapons  &  Materials  Research  Directorate, 

High-Strain  Rate  Hardness  of  Tungsten  Carbides 

Graduate  category  winners 

Gold  Medalist: 

James  (Matt)  Mansell,  Weapons  &  Materials  Research  Directorate 
Modeling  RDX  Decomposition  Products  with  Mesoscale  Particles 

Silver  Medalist: 

Minas  Benyamin,  Sensors  and  Electron  Devices  Directorate 
Limits  of  Subpixel  Motion  Detection  with  a  Video  Camera 

Bronze  Medalist: 

Maxwell  Alander,  Human  Research  &  Engineering  Directorate 
The  Effect  of  Imperceptible  Noise  Stimulation  on  the  Spinal  Reflex 

Special  awards  were  presented  to  2  of  the  top  student  presentations  from  ARL 
West. 

ARL  West  top  honors  for  2017  presentations: 

Undergraduate  category:  Elnaz  Ahmadi,  University  of  California,  Santa  Barbara 
Graduate  category:  Tiffany  Raber,  University  of  Illinois  at  Chicago 
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Undergraduate  and  graduate  Directorate  Finalists  who  participated  in  the  U.S.  Army  Research  Laboratory's  2017 
Summer  Student  Symposium  held  August  10  at  Aberdeen  Proving  Ground,  Maryland.  (U.S.  Army  photo  by  Conrad 
Johnson,  RDECOM). 


https://arlinside.arl.army.mil/inside/news/articles/view.cfm?id=2051 


The  undergraduateGold  Medalist, Sarah  Adams;  Silver  Medalist,  Peter  Deavilleand  Bronze  Medalist,  Luke  Hanner  display 
their  winnings  from  the  U.S.  Army  Research  Laboratory's  2017  Summer  Student  Symposium  held  August  10  at  Aberdeen 
Proving  Ground,  Maryland.  (U.S.  Army  photo  by  Conrad  Johnson) 

https://arlinside.arl.  army.mil/inside/news/articles/view.cfm?id=2051 
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The  graduateGold  Medalist,  James  (Matt)  Mansell;  Silver  Medalist,  Minas  Benyaminand  Bronze  Medalist, 
Maxwell  Alander  display  their  winnings  from  the  U.S.  Army  Research  Laboratory's  2017  Summer  Student 
Symposium  held  August  10  at  Aberdeen  Proving  Ground,  Maryland.  (U.S.  Army  photo  by  Conrad  Johnson,  U.S. 
RDECOM) 

https://arl  inside,  arl.  army,  mi  l/inside/news/articles/view.cfm?id=2Q51 
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Blake  Anderson 


I  am  currently  a  senior  attending  the  University  of  Oklahoma  (OU).  My  major  is 
engineering  physics  with  a  design  sequence  focusing  on  aerospace  engineering; 
more  specifically,  I  am  focusing  on  the  controls  side  of  aerospace.  I  began  doing 
research  at  the  Advanced  Control  Systems  Lab  (ASCL)  at  OU  in  May  of  2016.  At 
ASCL,  we  have  been  focusing  on  creating  easy-to-use  interfaces  for  control  testing 
and  accurate  virtual  simulators,  as  well  as  designing  autopilots  with  nonlinear 
controls  for  multirotor  vehicles.  My  current  advisor,  Dr  Andrea  L’Afflitto,  runs 
ASCL,  and  after  graduating  this  December,  I  plan  on  pursuing  my  master’s  degree 
in  aerospace  engineering  under  his  guidance. 


UNCLASSIFIED 


Robust  Adaptive  Control  of  Unmanned 
Aerial  Systems  (UAS) 


Blake  Anderson 
University  of  Oklahoma 
VTD  -  Autonomous  Systems  Division 
Mentors:  Harris  Edge  and  Jim  Dotterweich 


The  Nation’s  Premier  Laboratory  for  Land  Forces 
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Problem  Statement 


ARL 


Controls  research  focusing  on  allowing  drones  to  do 
work  in  an  unstructured  environment 


Environmental  Interaction 

•  Perching  r 

•  External  factors  (wind,  rain, 
etc.) 

•  Payload  Manipulation 
(swinging  payloads) 

New  problems 

•  Changing  mass 

•  Dynamic  payloads 

•  Surface  interaction 
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The  Nation’s  Premier  Laboratory  for  Land  Forces 


*  Design  and  implement  a 
robust  adaptive  controller  for 
a  quadrotor  vehicle 

•  Created  a  new  methodology: 

•  Created  reliable  virtual 
simulator  for  testing  & 
performance  prediction 

•  Odroid  single  board 
computer  connected  to  a 
Pixhawk  autopilot 
running  the  open  source 
PX4  flight  stack. 


•  Gen  I:  flown  1999,  2003 

•  Genii:  2002  -  2006 

✓  flight  test  4th  Q  2005 

•  Gen  IN:  2006 
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The  Nation’s  Premier  Laboratory  for  Land  Forces 
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IIMPI  A^IFIFn 


•  Advanced  control  techniques 
that  guarantee  robustness  to 
strong  external  disturbances, 
failures  of  the  propulsion 
system,  &  high  safety  margins. 


*  Rapid  development  of  new 
control  algorithms  by 
streamlining  the  transition 
between  control  design, 
simulation,  &  experiments. 
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The  Nation’s  Premier  Laboratory  for  Land  Forces 


US  ARMY 

RDECOM 


UNCLASSIFIED 


Control  Approach 


Adaptive  Sliding  Mode 


•  Gains  are  now  functions  of  time 
*  Classic  PID  gains  are  fixed 


•  Corrects  for  uncertainties  the  system 

•  Different  masses,  inertias,  or  even  actuator  faults 
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Hardware  in  the  Loop  Simulation 


•  HIL  simulation 
executes  the  exact 
same  code  structure 
that  runs  in  real  flight.  10 

“  0 
>« 

•  Reduced  risks  & 

-10 

better  use  flight  test 
time 

•  Uses  QGroUndControl  Chosen  simulator:  jMAVSim 


t 
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The  Nation’s  Premier  Laboratory  for  Land  Forces 
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Results 


ARL 


m 


Waypoint  and  Trajectory  Following 


Flight  test  results  showing  the  quad  following  circle  of  2  m 
radius  at  constant  altitude 


Avg  error  in  x-y  <  9  cm  Avg  error  in  z  <  3  cm 
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The  Nation’s  Premier  Laboratory  for  Land  Forces 
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Results  IV 


Changing  Payload 


be 

c73 


Offboard  Control  Initiated 


Mass  Released 


10 


Time  [s]  14 


18 


22 


ARL  1(25 


Mass  of  the 
vehicle  is 
changed 
approximately 
40% 


•  Correction  occurs  in  under  3  s 

•  Controller  tuned  for  and  assumes  mass  of  .91  kg, 
actual  mass  =  1.4  kg 


The  Nation’s  Premier  Laboratory  for  Land  Forces 
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Results  V 


ARL 


PID 


Adaptive  Sliding  Mode 


Much  slower  response  Returns  to  desired 
to  disturbance  height  in  under  3  s 
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Results  VI 


Mass  Disturbance 
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s  Successful  virtual,  hardware-in-the-loop,  and  indoor 
tests  for  proposed  control  algorithm. 

S  Shown  higher  performance  with  respect  to  classical 
PID-based  autopilots. 

s  Successfully  demonstrated  disturbance  rejection 
with  changing  mass. 


Near  Future  Work 

More  indoor  and  outdoor  tests. 

Matching  simulation  and  test  results. 

Carrying  dynamic  payload. 

12 


ARL  Collaboration  with  University  of  Oklahoma 

•  Open  Campus  --  Discussions  with  ASD 

•  Signed  a  CRADA  --  Joined  ARL  South 

•  Taking  the  same  vehicle  to  test  in  a  similar  Vicon 
system 


OU  ARL 
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Benjamin  Kolarik 


I  am  a  senior  undergraduate  student  in  computer  science  at  the  University  of 
Maryland,  Baltimore  County  in  Catonsville,  MD.  This  is  my  first  summer  in  the 
ARL  internship  program.  After  graduating  I  hope  to  work  in  the  field  of  computer 
graphics,  either  with  ARL  or  in  the  private  sector. 

I  would  like  to  thank  my  mentors  for  their  assistance  in  this  work,  as  it  would  not 
have  been  possible  without  them.  This  summer  has  improved  my  knowledge  in  the 
field  of  computer  graphics  as  well  as  given  me  workplace  experience. 
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Dynamic  Occlusion  Culling  in  Virtual  Reality 


Benjamin  Kolarik 


Mentors: 
Lee  Butler 
Tim  Myers 


Autumn  Kulaga 
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Issues  with  vehicle  geometry  in  VR  MliL 


Some  game  engines  are  designed  to  work  well  with  VR. 
However,  the  texture  optimization  that  most  products 
produced  on  these  engines  uses  cannot  be  used  for 
vehicle  analysis. 
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Occlusion  culling  explanation  cont.  ARL  U5)| 

/  / 

/  / 

Blue  cubes  aren't 

m 

/ 

■  ■ 

rendered  because 
they  are  blocked, 
or  occluded  by 

/  / 

other  cubes. 

■ 

■ 

■  ■ 

Green  cubes  aren’t 

// 

rendered  because 

// 

/  / 

they  are  outside  of 

■ 

! 

■ 

■  ■ 

the  viewing 
frustum. 

White  cubes  are 

|  ■ 

rendered. 
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Occlusion  culling  doubles  performance 


ARL 


This  test  case  we  developed  simulates  complex 
geometry  using  over  4000  Menger  sponges,  which  is  an 
appropriate  approximation  of  the  geometry  ARL  uses. 

When  occlusion  culling  is  used,  performance  increases 
due  to  the  decreased  number  of  objects  that  need  to  be 
shown.  c 
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Menu  for  visibility 


ARL 


=i* 


Analysts  often  need  to  see  parts  of  geometry  that  are  inside  the  vehicle. 

This  menu  allows  them  to  view  that  geometry.  q 
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Sarah  Adams 


Sarah  Adams  is  a  senior  majoring  in  materials  science  and  engineering  at  the 
University  of  Maryland.  This  summer  her  research  covered  the  fabrication  and 
combustion  of  silicon  nanoparticles  made  from  porous  silicon  films.  Sarah 
previously  worked  in  the  Center  for  Nanophysics  &  Advanced  Materials  at  the 
University  of  Maryland,  studying  the  effects  of  lanthanide  superconductor  doping 
and  the  application  of  the  Kondo  insulator  SmB6  as  a  driver  for  self-oscillating 
circuits.  She  will  graduate  in  December  of  this  year,  at  which  point  she  plans  to 
enter  the  workforce  prior  to  returning  to  school  to  complete  a  master's  degree. 
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Fabrication  &  Characterization  of  Silicon 
Nanoparticles  for  Energetic  Applications 

Sarah  K.  Adams,  sarah.k.adams8.ctr@mail.mil 

Mentor:  Nicholas  Piekiel.nicholas.w.piekiel.civ@mail.mil 
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Background 


On-chip  Energetics 

Advanced  electronics/MEMS  capabilities 


Army  Applications: 

•  Microthrusters 

•  Thermal  battery  actuation 
(FY17-19  ManTech) 

•  Fuzing 

Desired  Properties: 

s  High  energy  density 
s  High  power  density 
s  Inexpensive 


ARLSM) 


10 


Nano- 
thermites 

ultra-  /^' 

capacitprs  .  'Conventional 

.^packaging  y  energetics 


capacitors 
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Power  Density  (W/g) 
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Porous  Silicon 


ARL 


PSi  films  well-studied  for  energetic  properties 

-  Tunable  flame  speeds:  1  m/s  to  3000  m/s 

-  High  surface  area  (>800  m2/g),  hydrogen-terminated  surface 
Reacts  well  with  NaCI04 


2  +  n 

(1  -  n)Si  -I-  nSiH2  H - - —  NaC104 


SiO?  +  NaCl  -I-  nH70 


Formed  by  electrochemical  etch  in  HF  Limited  applications 
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Goals 

•  Reduce  requirements  for  PSi  applications 

•  Create  avenues  for  new  applications: 

•  Additive  manufacturing 

•  Fuel  additives 

•  Apply  to  chips  without  HF  etch 

•  Applicable  to  any  substrate 
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Elemental  Analysis 


ARL 


0  100  200  300  400  500  600 

Temp  (°C) 

Differential  Scanning  Calorimetry 


Silicon:  1.739  eV 

/ 

i 

1 

s 

S  f 

3 

HJ 

1 _ 

i 

_ A _ 

4  6 

X-Ray  Energy  (eV) 


10 


Frequency  (cm*1) 

Fourier  Transform  Infrared 
Spectroscopy 


Energy  Dispersive  X-Ray 
Spectroscopy 

Less  than  3%  Oxygen 
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Absorbance 
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Imaging 


ARL 


SEM 

Small  clusters  of 
particles  seen 


TEM/STEM 

~5  nm  diameter  particles 


120  180 
Sonication  Time  (min) 


*3:1  HFrEtOH 

♦  6:1  HF:EtOH 
■  12:1  HF:EtOH 

•  20:1  HF:EtOH 

240 


*  3:1  HF:EtOH 
•♦•6:1  HF:EtOH 
■  12:1  HF:EtOH 

•  20:1  HF:EtOH 


120  180 
Sonication  Time  (min) 


Pore  sizes  remain  small 

Surface  area  shows  downward  trend 

Sonication  affects  films  differently: 

•  Film  thickness,  pore  size,  etc. 

•  Little  relation  seen  between  porosimetry  results  and  flame  speeds 
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Bomb  Calorimetry 


ARL 


8  _ 

. . . .  . . . 

—  7  .  . . .  . .  . 

•se  - - v - - 

26  '■ 

C  6  . .  . . .  A... 

o  *••»*;:;: .  . . . 

■3 ,  * 

3  5 

-Q  _ . _ _ 

1  4 
u 

‘4- 

2  3 

ro 
0) 

J2 


•♦•3:lHF:EtOH 
•♦•6:1  HF:EtOH 
•■•12:1  HF:EtOH 
•  20:1  HF:EtOH 


-  04:  6.6  kJ/g 


-  TNT:  4.2  kJ/g 

-  Thermite:  3.5  kJ/g 


60  120 

Sonication  Time  (min) 


180 


240 


Samples  are  capable  of  retaining  energetic  quality  after  several  hours  of  sonication. 
Despite  downward  trend,  high  flame  speeds  are  seen. 
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Explore  sonication  parameters 

Will  higher  amplitude  or  longer  time  create  more  consistent  particle 
sizes? 

Quantify  polydispersity 

How  does  the  distribution  of  particle  sizes  change  with  sonication  time? 
->  How  does  distribution  of  particle  sizes  affect  flame  speeds? 

Explore  new  methods  for  PSi  application: 

->  Inkjet  printing/additive  manufacturing 
->  Evaporation-driven  assembly 
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Summary 


AKLm 


1 .  Particles  retain  hydrogen-terminated  surface  after  sonication  in 
liquid  medium  -  importantfor  inkjet  printing  applications 

2.  Synthesis  method  produces  particles  <5  nm  in  diameter 

3.  Particles  retain  similar  surface  area  &  combustion  properties  to 
original  film 

4.  Particle  flame  speeds  competitive  with  fastest  reported  for  film 
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Sonication  Media 
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Ethanol-  Toluene+Methanol -  DMF — Commercial  SiNP 


125  225  325  425 

Temperature  (°C) 
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Heat  vs.  Flame  Speed  ARL 
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Peter  Deaville 


I  am  a  rising  senior  electrical  engineering  student  at  the  University  of  Maryland, 
College  Park.  This  is  my  first  research  experience  and  my  first  internship  at  the  US 
Army  Research  Laboratory  (ARL).  Previously  I  completed  a  co-op  in  avionics 
integration  at  Bell  Helicopter.  My  interests  are  in  microelectronics  (particularly 
low-power,  embedded  systems)  and  in  signal  processing.  In  the  future,  I  hope  to 
attend  graduate  school  with  the  goal  of  working  in  research  in  either  the  public  or 
private  sector. 

I  would  like  to  acknowledge  the  mentorship  of  David  Hull,  and  the  assistance  of 
Sean  Heintzelman.  I  had  a  very  positive  experience  at  ARL,  and  gained  an 
invaluable  amount  of  experience  this  summer. 
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Ultra-Low-Power  Sensing  &  Processing 


Peter  Deaville 

Mentor:  David  Hull,  Electric  &  Magnetic  Field  Team  Lead 
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Importance  of  Power 


ARL 


ARTEMIS-Mobile  Power  Consumption:  ~2  W 


Regularoperation: 

3  BB-2590  batteries  would  last 
2  weeks 


Using  a  2-mW  wake-up  system  to 
detect  events: 

A  small  solar  panel  could  power  the 
system  continuously 

(or  a  single  BB-2590  for  a  year) 
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•  Goal:  compare  sensing  and  processing  methods  for  low-power 
phasor  extraction 

•  Explore  low-power  E/H  sensor  options 

•  Compare  analog  signal  processing  with  low-power  digital 
microcontrollers  (MCUs) 

•  Target  <1  mW  continuous  operation 


Aspinity  RAMP  Analog/Mixed 
Signal  Processor 


Tl  MSP430  digital 
microcontroller 


Microchip  PIC  digital 
Microcontroller 


20  uW* 
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200  uW/MHz**  900  uW/MHz 
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Digital  Low-Power  Potential 


AHLim 


2008*2009  laptops 


>  Koomey’s  Law:  similarto 
Moore’s  law 


>  Power-efficiency  of  digital 
electronics  doubles  every 
18  months 
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lY)  rdecom  Benchmarking  Digital  Options  MliL  [253. 
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MSP430  vs  PIC  Active  Mode  Baseline  Power  Consumption 


8/16-Bit  PIC  vs  MPS430  Power  vs  Frequency  (Active 

Mode) 

100 


§ 

E 


o 

Q_ 


10 

1 

0.1 


■  8-Bit  PIC 
•  MSP430 
a  16-bit  PIC 


0.01 


0.01  0.1  1  10  100 
Frequency,  MHz 

Only  the  MSP430  achieves  sub-mW  performance  at  1  MHz 
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Tl  MSP430 

Microchip  PIC 

Active  Mode 

Power 

(Baseline,  1  MHz) 

570  UW 

2200  uW 

Idle  Power  121  uW 


5  -  50  uW 


The  Microchip  PIC  series  will  have  lower  power  only  for 
applications  with  duty  cycle  <  4% 

Therefore  PIC  is  less  useful  for  an  always-on  low-power  sensor 


i 
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Digital  Prototype:  Components  AliL 


Tl  ADS8866  ADC 

>  1 6-bit  SAR 
architecture 

>  Typically  adds  about 
10  uW 


Tl  SN74LV4051  8- 

Channel 

Multiplexer 

>  60  microwatts 
or  less  power 
consumption 


TIDRV5053  Hall-Effect 

Magnetic  Sensor 


>  0.288  mWwith  4.3% 
duty  cycle 
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900  uW  +  60  uW  +  10  uW  +  1100  uW*  =  2.1  mW 

Options  to  reduce  power: 

-  Use  1  or  2  Hall-effect  sensors  (but  can’t  do  phasor  calibration) 

-  Use  new  TMR  magnetic  sensor  (100  uW/channel,  but  unproven/expensive) 

-  Use  multiple  MCUs  (at  lower  clock  rates)  and/or  co-processor 
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rdecom  Digital  Prototype  Cycle  Breakdown>|#fL 

|§§ 

Sampling 

FFT 

Total 

Phase 

Calculation 

Phase 

Sampling/FFT 
Cycle  Power 

Power  (mW) 

2.96 

1.42 

2.18  mW 

Duration  (s) 

0.53 

0.54 

>  Equivalent  to  2.32  mJ/cycle,  where  a  cycle  is  512  samples  &  FFT 

>  Processorand  Hall-effect  sensors  consume  the  bulk  of  the  power 


ARTEMIS  System:  ~2  W 


lOOOx  Power 
Improvement 


Low-power  system 
with  MSP430:  ~2  mW 


IX 

MSP  430 
Utrt-lowPmN' 

> 

V 

■JtoTtXAS 

»  iNSTJUJMfJvrS 
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rdecom  Fast-Fourier  Transform  Result  mRL  §(2g 


I 


Real-world  events  were  simulated  using  a  60-Hz  input  to  one  of  the  sensor 
channels  (without  using  the  sensors  themselves) 


(D 

3 

P 

'C,  150 

CD 

CO 

N100 

X 
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20  mVpp  60- 
Hz  signal 


4  n 

••••• 

10  20 


/^50  mVpp60^N 

Hz  signal 

J  LI  Inputmagnitude  increased 

J  Inputturnedoffandon 

30  40 

Time  (s) 


This  test  could  last  for  166  days  using  two  AA  batteries 
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Alternative:  Analog  Processing  AliL 


Computation  Power  vs  Time,  Analog  and  Digital 


Analog  filterbanks  use  up  to  2  orders  of  magnitude  less  power 
than  a  comparable  digital  system 
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*Based  on  data  adapted  from  Aspinity  >|  2 
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Aspinity  RAMP 


ARL 
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>  Aspinity  RAMP  (Reconfigurable  Analog/Mixed-Signal  Processor) 
has  the  potential  to  run  phasor  extraction  in  the  analog  domain 
for  approximately  10-20  uW 

>  Eliminates  the  need  for  an  ADC 

>  Eliminates  the  need  for  the  microcontroller 

>  Can  be  run  continuously  -  no  need  to  sleep 


Digital  Prototype 


Hall 

Sensors 
(0.86  mW) 
ADC 
(0.3  mW) 

MSP430 
(-1  mW) 


X 

X 


Total  =  2.18  mW 


Analog  System 


Total  <  0.9  mW 


Hall 

Sensors 
(0.86  mW) 


RAMP  (20  uW) 
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rdecom  Ana|0g  phasor  Extraction  Results  MHL  mi 


Similar  to  the  digital  system  test,  a  waveform  generator  simulated 
events  on  the  sensor  input  channel 


This  test  could  last  for  >10  years  on  the  capacity  of  two  AA  batteries 
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Advantages/Challenges  in  Analog  AftL 


Challenges  Advantages 


Does  not  eliminate  the  high  power 
consumption  of  the  Hall  Sensors 

Operates  continuously  for  tens  of 
microwatts 

Not  as  easy  to  store  and  recall 
detailed  data  from  before  the 
detected  event 

Potential  for  adding  sensors 
directly  on-chip 

Limited  to  approximately  60  dB  of 
dynamic  range  (range  of  detectable 
amplitudes).  With  digital  system, 
can  achieve  80-100  dB. 

Fewer  components  involved  -  can 
be  used  as  an  analog  front-end  as 
well 

Unproven  for  use  as  a  calibrated 
measurement  in  a  standalone 
system 

_ lh 
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Digital  Processing: 

•  IQOOx  Power  Improvement  over  ARL  Mobile  Power  Meter 
Analog  Processing: 

•  2000x  Power  Improvement  over  ARL  Mobile  Power  Meter 
Both: 

•  Demonstrated  event  detection 

•  Battery  life  improvement  from  weeks  to  years 

•  Potential  for  future  power  efficiency  increases 

I  would  like  to  acknowledge  the  mentorship  of  David  Hull,  as  well  as  the 
valuable  assistance  provided  by  Sean  Heintzelman  and  Brandon  Parks 
on  the  E/H  Field  Sensing  Team. 
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>  Replace  FFTs  with  custom  phasor  processing  (may  have  similar 
power) 

>  Use  multiple  MCU’s  to  split  up  tasks  (i.e.,  one  for  sampling,  one 
for  processing) 

>  Add  event  classification  to  the  low-power  MCU,  leveraging 
machine  learning  techniques 

>  Explore  options  to  reach  next  milestone:  1  microwatt 

>  On  the  order  of  the  leakage  current  of  a  small  battery 
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Christina  Nguyen 


Christina  Nguyen  is  entering  her  senior  year  as  an  undergraduate  student  at  Temple 
University,  majoring  in  Neuroscience.  She  has  previous  research  experience  in  the 
lab  of  Gregory  Smutzer  at  Temple  University  determining  thresholds  for  tasting 
different  fatty  acids.  She  also  has  previous  experience  in  the  lab  of  Chantelle  Hart 
at  the  Center  for  Obesity  Research  and  Education  studying  how  adolescent  sleep 
habits  affect  eating  habits  and  weight.  This  summer  she  worked  in  the  Mission 
Impact  through  Neurotechnology  Design  (MIND)  lab  within  the  Human  Research 
and  Engineering  directorate  under  the  direction  of  J  Cortney  Bradford  and  W  David 
Hairston.  Her  work  this  summer  focused  on  determining  the  efficacy  of  US  Army 
Research  Laboratory-developed  carbon  polymer  electroencephalography  (EEG) 
electrodes  for  measuring  human  brain  signals.  After  graduation,  she  plans  to  attend 
medical  school  and  pursue  a  career  in  both  clinical  work  and  research. 
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A  Comparison  Study  of  Carbon  Polymer 
Electrodes  for  Electroencephalography 
(EEG)  Recording 


Christina  Nguyen 
Temple  University,  Undergraduate 
Human  Research  and  Engineering  Directorate 
US  Army  Research  Laboratory 
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Summer  Goals 


ARL 


•  My  background: 

•  Neuroscience  major 

•  Psychology  and  biology  lab  experience 

•  Hope  to  contribute: 

•  Use  neuroscience  background 

•  My  experience  with  testing  subjects  and  developing  testing 
protocols 

•  Results  that  lead  to  further  research 

•  Hope  to  learn: 

•  MATLAB  skills 

•  Details  of  a  career  in  research 
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Background:  EEG 


ARL 


Electroencephalography  (Vrocher  et  al.  2016) 

•  Measures  microvolt-level  electrical  activity  from  underlying 
brain  activity 

•  Picked  up  by  multiple  electrodes  on  scalp 

•  Recording  can  be  visualized  as  a  trace 

Army  Usage 

•  Monitor  Soldier  state,  which  can  indicate  Soldier  performance 


> 

3 

<D 

“O 

D 


Time  (ms) 

Figure  1.  Example  of  a  single  raw  EEG  trace 
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Background:  Electrodes  AftL 


Army  applications 

•  Safe  and  comfortable  field  electrode 

•  Reliable  data  collection 

Wet  vs  Dry  (Mathewson  et  al.  2017) 


Wet 

Dry 

Preferred  clinical  method 

Relatively  new 

Better  data  quality 

Poorer  data  quality 

Limited  usage  time 

Limited  usage  time 

Difficult 

Easy 

application/removal 

application/removal 

Figure  2.  Example  of  a  wet 
EEG  system 


Figure  3.  Example  of  a  dry 
EEG  system 
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Background:  Electrodes  ARL 

Solution:  Polymer  electrode 

•  Conductive  carbon  nanofiber-filled 
polydimethylsiloxane  (Slipher  et  al. 
2016)  ->  ARL  collaboration 

Functions  as  a  dry  electrode  without  the 
problems  associated  with  wet  and  dry 

Viable  option  shown  through  bench 
testing  before  my  internship 

Never  been  tested  on  human  subjects 

•  My  role  this  summer  from  May  2017 
to  August  2017  (10  weeks) 


Figure  4.  Top  view  of 
polymer  electrode 


Figure  5.  Side  view  of 
polymer  electrode 
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•  Three  electrodes  used: 

•  g. SAHARA  (dry) 

•  Carbon  polymer  with  silver  epoxy  coating 

•  Hydrodot  (wet) 


Figure  6.  Side  view  of  electrodes. 
From  left  to  right:  hydrodot,  polymer, 
g.SAHARA 


Figure  7.  Top  view  of  electrodes. 
From  left  to  right:  hydrodot,  polymer, 
g.SAHARA 
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•  Three  electrodes  used: 

•  g. SAHARA  (dry) 

•  Carbon  polymer  with  silver  epoxy  coating 

•  Hydrodot  (wet) 


Figure  6.  Side  view  of  electrodes. 
From  left  to  right:  hydrodot,  polymer, 
g.SAHARA 


Figure  7.  Top  view  of  electrodes. 
From  left  to  right:  hydrodot,  polymer, 
g.SAHARA 
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Experimental  Tasks 


ARL 


•  Four  tasks  given  to  test  electrodes'  ability  to  record  known  brain 
responses  and  its  susceptibility  to  noise 

•  Focus  was  using  a  rapid  serial  visual  presentation  (RSVP)  task 
(Ries  et  al.  2013) 

•  Images  flashed  every  500  ms  (target,  distractor,  background) 

•  Button  press  in  response  to  only  target  stimuli 


Figure  8.  Target  -  Figure  9.  Distractors-  No  Figure  10.  Background  - 

Button  press  button  press  No  button  press 
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record  known  brain 

responses 

•  Focus  was  using  a  rapid  serial  visual  presentation  (RSVP)  task 
(Ries  et  al.  2013) 

•  Images  flashed  every  500  ms  (target,  distractor,  background) 

•  Button  press  in  response  to  only  target  stimuli 


Figure  8.  Target  -  Figure  9.  Distractors-  No  Figure  10.  Background  - 

Button  press  button  press  No  button  press 
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Event  Related  Potential  (ERP)  ARL 


•  ERP:  Measured  brain  response  that  is  linked  to  a  specific  event 

•  What  is  P300? 

•  Component  of  ERP 

•  Decision  making  tasks  provoke  P300  response 

•  Why  P300? 

•  Well  documented  ->  High  reproducibility 

•  Differing  amplitudes  depending  on  stimuli  (Ries  et  al.  2013) 


- Distractor 

- Target 

- Background 

Time  (ms) 

Figure  11.  Example  of  an  expected  P300  response 
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RDECOM  Experimental  P300  AKL 


•  Three  different  curves 

•  Target:  Largest  amplitude 


Time  (ms) 


- Distractor  - Target  - Background 

Figure  12.  Example  of  expected  curves  for  different  stimuli  9 
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\YJ  RDECOM  Experimental  P300  AtiL 


•  Three  different  curves 


•  Distractor:  Second  largest  amplitude 


- Distractor  - Target  - Background 

Figure  12.  Example  of  expected  curves  for  different  stimuli  9 
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RDECOM  Headset  Development  A\RL 


•  Custom  headset  design  with  designated  10  -  20  locations 

•  Fpz,  Cz,  Pz,  Oz  (three  electrodes  per  region) 

•  Three  electrooculogram  (EOG)  sites 

•  Sixteen-channel  g. SAHARA  EEG  system;  15  channels  used 


Figure  13.  Channel  locations  based  on 
10-20  system 


Figure  14.  Top  view  of  custom  headset 

11 
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Headset  Development 


ARL 


•  Custom  headset  design  with  designated  10  -  20  locations 

•  Fpz,  Cz,  Pz,  Oz  (three  electrodes  per  region) 

•  Three  electrooculogram  (EOG)  sites 

•  Sixteen-channel  g. SAHARA  EEG  system;  15  channels  used 


Figure  15.  Posterior  view  of  custom  Figure  16.  Side  view  of  custom  headset 

headset  with  electrodes  snapped  in  with  electrodes  snapped  in  12 
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RDECOM  Raw  Data  Collection  AftL 


•  Sixteen  subjects;  only  used  9  subjects 

•  Each  subject  needed  all  3  electrode  types  with  sufficient  data 
quality  or  else  rejected 

•  Dry  electrodes  often  were  the  issue 

•  g. SAHARA  and  polymer  electrodes  were  equally  the  cause  of 
subject  rejection 


> 


< 


Time  (ms) 

Figure  17.  Example  of  a  single  EEG  trace  13 
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Pz  Grand  ERP:  Hydrodot  ARL 


Hydrodot  Electrode  Grand  ERP 

I  Distractor  Standard  Error 
-Distractor 

■  Target  Standard  Error 
-Target 

I  Background  Standard  Error 
-Background 


Figure  20.  Grand  ERP  of  hydrodot  electrode 
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Pz  Grand  ERP:  Hydrodot  ARL 
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Pz  Grand  ERP:  Hydrodot 


12 


Hydrodot  Electrode  Grand  ERP 

■  Distractor  Standard  Error 

—  Distractor 

■  Target  Standard  Error 
—Target 

■  Background  Standard  Error 

—  Background 


Figure  20.  Grand  ERP  of  hydrodot  electrode 


ARL 
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Pz  Grand  ERP:  g.SAHARA  ARL 
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Pz  Grand  ERP:  g.SAHARA  ARL 
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Pz  Grand  ERP:  g.SAHARA  ARL 


g.SAHARA  Electrode  Grand  ERP 


I  Distractor  Standard  Error 
-  Distractor 

I  Target  Standard  Error 
-Target 

I  Background  Standard  Error 
-Background 


P300 

Response  ( 

400  600 


12 

-200 


200 

Time  (ms) 


Figure  21.  Grand  ERP  of  g.SAHARA  electrode 


17 


public  release/distribution  unlimited  The  Nation’s  Premier  Laboratory  for  Land  Forces 


Approved  for  public  release;  distribution  is  unlimited. 


56 


UNCLASSIFIED 


US.  ARMY 

RDECOM 


Pz  Grand  ERP:  Polymer  ARL 


Polymer  Electrode  Grand  ERP 

I  Distractor  Standard  Error 
-  Distractor 

■  Target  Standard  Error 
-Target 

I  Background  Standard  Error 
-Background 


0 

^■-y  _  /  200 

1 

w  1  « 

- 

-6  - 

1 

1 

1 

1 

1 

1 

1 

ft  ; 

P300 

Response  1 

Time  (ms) 

Figure  22.  Grand  ERP  of  polymer  electrode 
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Polymer  Electrode  Grand  ERP 

I  Distractor  Standard  Error 
-  Distractor 

■  Target  Standard  Error 
-Target 

I  Background  Standard  Error 
-Background 


Time  (ms) 

Figure  22.  Grand  ERP  of  polymer  electrode 
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Polymer  Electrode  Grand  ERP 


-12 - ^  — 

-200  0  200  400  600 

Time  (ms) 


Figure  22.  Grand  ERP  of  polymer  electrode 
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RDECOM  Mean  Amplitude  Paired  t-Test  MKL 


•  Used  a  paired  t-test  with  Bonferroni  correction  to  determine 
whether  differences  between  conditions  were  significant 


•  Preliminary  results  show  significant  differences  for 
target/background  and  distractor/background 


g.SAHARA 

Polymer 

Hydrodot 

Target/Distractor 

p  =  0.181 

t  =  1.466 

p  =  0.0532 
t  =  2.267 

p  =  0.0515 
t  =  2.287 

Target/Background 

p  =  0.000145 
t  =  6.753 

p  =  0.000948 
t  =  5.084 

p  =  0.0000264 
t  =  8.574 

Distractor/ 

Background 

p  =  0.0024 
t  =  4.365 

p  =  0.000670 
t  =  5.369 

p  =  0.0000860 

t  =  7.274 

Table  1.  Achieved  p-values  when  comparing  differing  conditions  across  the  three 
electrode  types.  Green  is  significant  and  red  is  not  significant. 

Used  a  =  0.017.  Degrees  of  freedom  =  2.  20 
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•  Used  a  paired  t-test  with  Bonferroni  correction  to  determine 
whether  differences  between  conditions  were  significant 


•  Preliminary  results  show  significant  differences  for 
target/background  and  distractor/background 


g.SAHARA 

Polymer 

Hydrodot 

Target/Distractor 

p  =  0.181 
t=  1.466 

p  =  0.0532 
t=  2.267 

p  =  0.0515 
t=  2.287 

Target/Background 

p  =  0.000145 
t  =  6.753 

p  =  0.000948 
t  =  5.084 

p  =  0.0000264 
t  =  8.574 

Distractor/ 

Background 

p  =  0.0024 
t  =  4.365 

p  =  0.000670 
t  =  5.369 

p  =  0.0000860 

t  =  7.274 

Table  1.  Achieved  p-values  when  comparing  differing  conditions  across  the  three 
electrode  types.  Green  is  significant  and  red  is  not  significant. 

Used  a  =  0.017.  Degrees  of  freedom  =  2.  20 
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RDECOM  Mean  Amplitude  Paired  t-Test  MKL 


•  Used  a  paired  t-test  with  Bonferroni  correction  to  determine 
whether  differences  between  conditions  were  significant 


•  Preliminary  results  show  significant  differences  for 
target/background  and  distractor/background 


g.SAHARA 

Polymer 

Hydrodot 

Target/Distractor 

p  =  0.181 

t  =  1.466 

p  =  0.0532 
t  =  2.267 

p  =  0.0515 
t  =  2.287 

Target/Background 

p  =  0.000145 
t  =  6.753 

p  =  0.000948 
t  =  5.084 

p  =  0.0000264 
t  =  8.574 

Distractor/ 

Background 

p  =  0.0024 
t  =  4.365 

p  =  0.000670 
t  =  5.369 

p  =  0.0000860 

t  =  7.274 

Table  1.  Achieved  p-values  when  comparing  differing  conditions  across  the  three 
electrode  types.  Green  is  significant  and  red  is  not  significant. 

Used  a  =  0.017.  Degrees  of  freedom  =  2.  20 
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Discussion 

•  All  3  electrodes  were  able  to  measure  an  ERP  with  the 
characteristic  P300  signal  and  amplitude  pattern. 


•  All  electrodes  could  detect  a  significant  difference  between 
distractor/background  and  target/background. 

•  None  of  the  electrodes  could  detect  a  significant  difference 
between  target/distractor. 

•  Power  analysis  suggests  a  sample  size  of  n  =  10. 

•  Data  collection  is  ongoing 
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•  Objective  reached,  hypothesis  supported 

•  Polymer  electrode  was  able  to  record  the  expected  P300 
response  for  the  target,  distractor,  and  background. 

•  Promising  alternative  for  safe,  comfortable  electrodes  for  Army 
usage  in  the  field 

•  Issues  with  current  electrode  geometry 

•  Hard  to  get  through  hair  with  polymer  electrode 

•  Analyze  data  from  artifact-inducing  tasks  in  experiment 

•  We  only  looked  at  recording  known  brain  responses. 
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RDECOM  Effect  Size  of  Mean  Amplitude  AfitL 


•  Found  effect  size  of  statistically  significant  results  with  estimated 
standard  error  of  effect  size 

•  These  differences  had  a  large  effect  (desire  >  0.5) 


g. SAHARA 

Polymer 

Hydrodot 

Distractor/ 

Background 

2.21 

(S.E.:  0.59) 

2.53 

(S.E.:  0.62 ) 

3.51 

(S.E.:  0.73) 

Target/ 

Background 

2.97 

(S.E.:  0.67) 

2.93 

(S.E.:  0.66) 

3.06 

(S.E.:  0.68) 

Table  2.  Effect  size  of  statistically  significant  conditions  in  relation  to  desired  effect  size 
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About  Me 


ARL 


•  From:  Knoxville,  Tennessee 

•  School:  University  of  Tennessee 

•  Degree:  BS  in  electrical  engineering 

•  Starting  Masters  in  electrical  engineering  in  the  Fall 

•  Undergraduate  Research:  Neuromorphic  Circuit  Design  and 
Applications 

•  Been  with  ARL  for  12  weeks 

•  cwong11@vols.utk.edu 
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•  Thenumberoftransistorsona  chip  doubles  about  every  2  years, 
thus  improving  computing  performance. 

•  The  computing  performance  associated  with  Moore’s  Law  has 
begun  to  plateau  due  to  the  sizing  transistors  below  10  nm  and 
quantum  tunneling. 

•  Using  Neuromorphic  Computing  to  go  overcome  Moore’s  Law. 


1 1 5  Years  of  Moore’s  Law 
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Neuromorphic  Computing  ARL 


•  Neuromorphic  Computing:  mimicking  biology  and  the  brain  using 
integrated  circuits 

•  Advantages:  size,  weight,  and  power  (SWP) 

•  Programmable  Neuromorphic  Hardware  e.g.  IBM  TrueNorth 

•  Synapses  -  determine  the  amount  of  action  potential 
(charge/weight)  to  send  to  a  neuron 

•  Axon  -  connection  between  neurons  and  synapses 


Neurons  -  collect  action  potential  and  spikes  when  a  threshold  is 
met 
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Project  Description 


ARL 


•  The  idea  of  merging  Neuromorphic  Computing  and  robotics.  As  well, 
merging  theory  and  simulation  with  real  world  applications. 

•  Overall  Goal  -  Design  a  platform  for  testing: 

•  Different  neuromorphic  hardware  (e.g.,  TrueNorth,  FPGA) 

•  Architectures  (e.g.,  TrueNorth,  MrDANNA,  DANNA) 

•  Training  methods  (e.g.,  supervised,  unsupervised,  online,  offline) 

•  Connecting  hardware  (e.g.,  sonar,  camera,  motor,  LIDAR,  phones) 

•  Short  term  goal 

•  Design  a  Collision  Avoidance  Robot  that  drives  autonomously  using 
Neuromorphic  Hardware. 

•  Work  based  off  of  University  of  California,  Irvine’s  Jeff  Krichmar  and 
research  group.  Project  differs  by  hardware,  learning  algorithms,  and 
application  used. 
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Collision  Avoidance  Robot  ARL 


•  Purpose:  Autonomously  avoid  colliding  into  objects  using  IBM 
TrueNorth  and  Convolutional  Neural  Networks  (CNN)  to  determine 
the  output  motor  response. 

•  Three  sonar  sensors  placed  on  the  left,  center,  and  right  side  of 
the  car  are  used  to  detect  objects. 

•  Four  predefined  motor  control  commands:  Forward,  90  degree  left 
turn,  90°  right  turn,  and  reverse 

•  Two  main  components  to  the  project:  Robotics/Electronics  and 
Neuromorphic  Process 


•  Three  sonar  sensors  -  measures  the  amount  of 
time  the  sound  wave  bounces  back  to  the 
object  and  produces  an  analog  output 

•  Arduino  Mega  -  programmable  microcontroller 
written  in  Arduino’s  version  of  C/C++ 

•  Motor  controller  -  intermediary  between  the 
Arduino  and  DC  motors  to  control  speed  and 
direction  of  the  motor 

•  Serial  Bluetooth  module 

•  Six  DC  motors  -  tank  control  method  (turning 
controlled  by  stopping  or  reducing  the  speed 
of  the  left  or  right  motor) 

•  IBM  TrueNorth  -  programmable  neuromorphic 
chip 
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(▼)  RDECOM  Electronics  Diagram  fiRL  (2§)/ 


Electronics  Diagram  of  Neuromorphic  Collision  Avoidance  Robot 

MaxSonar 

Sensors 


^  ^  - 
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•  Neural  Networks  are  essentially  Black  Boxes. 

•  In  this  case,  Black  Box  equals  a  Fully  Connected  Forward  Pass  CNN. 

•  Incorporating  TrueNorth  with  Robotics: 

•  Step  1:  Learn  about  TrueNorth  Architecture  and  Corelet  Programming 

•  Step  2:  Create  a  TrueNorth  Control  Corelet  based  off  of  a  truth  table 
approach 

•  Step  3:  Create  communication  between  Arduino  and  TrueNorth 

•  Step  4:  Collect  Training  Data 

•  Step  5:  Create  Trained  CNNs 


UNCLASSIFIED 


The  Nation’s  Premier  Laboratory  for  Land  Forces 


Approved  for  public  release;  distribution  is  unlimited. 


69 


UNCLASSIFIED 


US.  ARMY 

RDECOM 


TrueNorth  and  Corelets  AR.L  :(2S. 


•  IBM  TrueNorth  -  programmable  neuromorphic  chip 

•  Corelet  programing  -  process  of  converting  neural  networks  into  the  TrueNorth 
framework  (Matlab  functions  provided  by  IBM) 

•  Corelet  Process:  set  up  input  and  output  pins,  Neurosynaptic  Cores,  Synaptic 
Crossbar,  and  Neuron  parameters  (e.g.  weight,  threshold)  which  produces  model 
and  connection  files  that  can  be  imported  to  TrueNorth 

•  TrueNorth  Constraints  -4,096  Neurosynaptic  Cores,  maximum  of  256  Neurons  and 


Axons  per  core,  maximum  of  65,536  Synapses  per  core 

•  Four  axon  types  -  maximum  of  4x256  different  weights 

•  256  neuron  types  -  maximum  of  256  synaptic  connections  per  neuron 


m 


UNCLASSIFIED 


US.  ARMY 

RDECOM 


Control  Corelet 


ARLm 


I 


•  Translating  a  truth  table  into  a  fully  connected  Corelet 

•  No  learning  -  determined  the  neuron  parameters  and  framework  by  hand 

•  Focus:  learn  howto  correctly  utilize  the  IBM  provided  Matlab  functions 
used  to  set  up  the  input  and  output  connections,  crossbar,  and  neuron 
parameters 

•  Truth  Table: 

•  1  represents  the  sonar  value  is  below  a  user  defined  value/  object  is 

close 


•  0  represents  the  sonar  value  is  above  a  user  defined  value 


1  represents  when  a 
sonar  sensor  receives 
a  reading  below 
a  specified  range. 

0  represents  when 
a  sonar  sensor  does 
not  receive  a  reading 
below  a  specified 
range. 

F  =  Forward 

L  =  Left 

R  =  Right 

Rev  =  Reverse 

Order  of  Priority: 

F  ->  L  ->  R 

Left 

Center 

Right 

Output 

0 

0 

0 

F 

0 

0 

1 

F/L 

0 

1 

0 

UR 

0 

1 

1 

L 

1 

0 

0 

F/R 

1 

0 

1 

F 

1 

1 

0 

R 

1 

1 

1 

Rev 

Example  When  Threshold  =  25in 

Sonar  Range  (Inches) 

Corresponding  Motor 
Direction 

Left 

Center 

Right 

41 

24 

22 

Left 

15 

23 

30 

Right 

35 

78 

29 

Forward 
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Physically  connected  using  USB 
TrueNorth  has  Ubuntu  on  it 
Import  model  and  connection  files  created 
by  the  Corelet  onto  TrueNorth 
Python  script  runs  the  model  and 
connection  files  on  TrueNorth,  and  reads 
and  writes  serial  data  between  the  Arduino 
and  TrueNorth 

Python  script  utilizes  multiprocessing  by 
splitting  up  the  processes  of  reading  data, 
running  the  Corelet,  and  writing  the  data 


IBM  TrueNorth 


TrueNorth  Communication  (Python) 

Read  Serial  Data/ 

Sonar  Data 


Convert  Input 
Data  into  Spikes 


Input  of  Neural  Network 


Run  Data  through  :FromMo(teland 

Neural  Network/  : connection  rues 

Model  File 


Output  Response 
In  Spiking  Format 

. I . 

Translate  Output  Response 

1 

Write  Serial  Data  to  Arduino/ 
Motor  Command 
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Collecting  Training  Data  AKL  05} 


•  Supervised  Learning  -  mapping  3  sonar 
values  to  motor  control  commands 

•  Process:  Capturing  and  writing  direction  and 
sonar  values  to  a  text  file  while  manually 
driving  the  robot  around  an  obstacle  course 

•  Script  and  GUI  written  in  Processing,  which 
controls  the  robot,  captures,  and  shows  the 
direction  and  sonar  values  in  real  time 

45  Left/q 

Forward/w  45  Right/e 

90  Left/a 

/z 

Reverse/s  90  Right/d 

•  Processing  and  Robot  connected  though 
Bluetooth  Communication 

Stop/spacebar 

•  Amount  of  data  points  dependent  on  sonar 
sampling  rate 

Direction: 

Rangel: 

0, 

0, 

Range2:  RangeB: 

0,  0, 

•  Limitation:  only  as  good  as  the  driver  and 
consistency 
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Creating  Trained  CNNs  AliL 


•  Input:  Sonar  and  Direction  training 
datasets 

•  Output:  Network  and  Connection  files 

•  Process  of  updating/training  the  neuron 
parameters  and  structure  of  the  neural 
network  using  techniques,  such  as 
Backpropagation  or  EEDN  learning 
(Energy  Efficient  Deep  Neuromorphic 
Networks) 

•  The  created  network  and  connection  files 
are  imported  onto  TrueNorth  and  tested 
using  the  TrueNorth  Communication 
Python  script 


Training  (Matlab) 


Sonar  Training  Dataset 

i 

Convert  to  Spikes 

i 

Generate  Neural  Network 

i 

Update/Train  Network 

Direction 

Training - ►  Test  Neural  Network 

Dataset 


Create  Network  and 
Connection  files 
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What  Went  Wrong 


ARL 


•  Original  idea:  Design  a  robot  that  drives  autonomously  around  an 
obstacle  course  using  Neuromorphic  Hardware  and  LIDAR  unit 
stripped  from  a  Neato  XV-11  vacuum  cleaner 

•  LIDAR  unit’s  photodiode  broke  which  caused  a  set  back  to  sonar 

•  Limitations  with  serial  data  transfer  and  corruption  bits 

•  IBM  TrueNorth  issues  with  open  MPI  and  libraries 

•  Timing  issues  with  TrueNorth  and  Arduino 
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Current  Progress 


AtiLim 


•  Completed 

s  Training  robot  and  Real  Data 
collection 

s  Hardware  and  electronics  aspects 
finished 

s  Control  Corelet 

s  Communication  TrueNorth  Python 
script 

s  Control  Corelet  Test  with  Buttons, 
LEDs,  and  TrueNorth  -  truth  table 
Corelet  created  and  successfully 
implemented  on  TrueNorth 
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Needs  Work 


ARL 
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•  Close  to  being  completed 

•  Intermediate  steps  between  TrueNorth  Python  and  startup 
scripts 

•  Demo  of  Collision  Avoidance  Robot  with  Control  Corelet 

•  Needs  Work/Passing  off  to  teammate  Elizabeth 

•  Training  networks 

•  Testing  and  verification 
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•  Due  to  what  went  wrong,  no  data  has  been  collected. 

•  Tests  for  data  and  results: 

•  Performance  Metrics: 

•  Accuracy  of  the  trained  neural  network 

•  Power  consumed  by  the  TrueNorth  (wattage  and  energy) 

•  Speed  of  the  neural  network  (how  long  it  takes  to  obtain  output 
response) 

•  Temperature  of  the  chip 

•  How  Performance  Metrics  are  affected  by: 

•  Preprocessing  input  data 

•  Using  different  spiking  formats 

•  Complexity  of  the  network 

•  Training 

•  Compare  against  similar  applications 
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•  What’s  next  for  my  project? 

•  Expand  to  different  or  mix  of  hardware  (e.g.,  phones,  cameras,  sensors, 
LIDAR,  touch  screen) 

•  Apply  different  learning  methods  (e.g.,  supervised,  unsupervised,  online, 
offline,  reinforcement,  genetic  algorithms) 

•  Apply  different  architectures  (e.g.,  TrueNorth,  MrDANNA,  DANNA) 

•  Future/Different  Neuromorphic  Applications 

•  Autonomously  driving  -  trail  navigation,  object  avoidance,  following  robot 

•  Image  recognition  -  classifiers,  phone  application  for  determining 
objects,  facial  detection 

•  Stability  -  balancing  objects,  helicopter,  quadcopter,  and  camera 
stabilization 


<C  _  $ 


4  4 


I  seeeosuaio  C0nVRPLIDAR-A2-Tne-Tmne8H.  IDAR-p-2687  : 


rups.'.wimmons  wWmeaia  orgWFiie  WMCH_Drone  jpg 
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rdecom  Frequently  Asked  Questions 


•  Why  use  TrueNorth  or  Neuromorphic  Computing  Architectures  instead  of 
a  small  computer  (e.g.,  Raspberry  Pi)? 

•  Neuromorphic  Computing  is  NOT  a  replacement  but  an  alternative  to 
tradition  computing 

•  SWP  -  Size,  Weight,  and  Power 

•  Raspberry  Pi  3  consumes  Watt  idle,  TrueNorth  consumes  OOmW  or 
less  depending  on  the  network 

•  Prospective  solution  Memristor  and  CMOS  application  specific  chips 
consuming  -1  mW  or  less  depending  on  the  network 

•  Application  specific  chips  -  chips  dedicated  to  do  one  job/process  (e.g., 
autonomous  driving,  stability,  image  recognition) 

•  This  already  exists.  What  makes  this  different? 

•  University  of  California,  Irvine’s  Jeff  Krichmar  and  research  group  has 
developed  this  type  of  application. 

•  Differences:  hardware,  learning  algorithms,  and  application 

20 


The  Nation’s  Premier  Laboratory  for  Land  Forces 


m 


UNCLASSIFIED 


US.  ARMY 

RDECOM 


Conclusion 
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Neuromorphic  computing  is  one  way  of  going  beyond 
Moore’s  Law. 

Main  Idea  of  Project:  Merging  Neuromorphic  Computing  and 
robotics.  As  well,  merging  theory  and  simulation  with  real  world 
applications. 

Overall  Goal:  Design  a  platform  for  testing  Neuromorphic  hardware 
and  concepts. 

Short  Term  Goal:  Design  Collision  Avoidance  Robot  using 
Neuromorphic  Hardware. 
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Luke  A  Hanner 


I  am  a  rising  pre-junior  at  Drexel  University  in  Philadelphia,  Pennsylvania,  where 
I  am  studying  materials  science  and  engineering.  Last  summer  I  participated  in 
Drexel’ s  Students  Tackling  Advanced  Research  (STAR)  program,  where  I 
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experience  and  I  began  work  on  this  project  in  May.  In  the  future  I  hope  to  earn  my 
master’s  degree  and,  possibly,  a  doctorate  in  materials  science. 
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High-Strain  Rate  Hardness  of  Tungsten  Carbides 
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Objectives 


-  The  mam  objective  of  this  investigation  was  to  gain  a  greater  understanding  of  how 
Tungsten  Carbide  performs  in  ballistic  applications. 

*  In  order  to  achieve  this  goal  I  performed  the  following  tasks: 

1,  Implement  a  Dynamic  Indentation  Hardness  Tester  (DIHT) 

2,  Write  MATLAB  code(s)  to  analyze  the  output  signals 

3,  Perform  quasi-static  and  dynamic  Knoop  hardness  testing  of  Tungsten  Carbide 

4,  Determine  the  impact  of  binder  percentage  and  grain  size  on: 

a.  Quasi-static  and  dynamic  hardness 

b.  Increase  in  dynamic  vs  quasi-static  hardness 
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What  is  Tungsten  Carbide? 
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*  Tungsten  Carbide  (WC)  is  a  cemented 
ceramic  material  composed  of  a  hard 
WC  main  phase  and  a  softer,  more 
ductile  metal  binder  phase. 

■  The  conventional  binder  is  cobalt. 

*  WC  is  used  in  the  M993  and  M995  armor- 
piercing  rounds  (amongst  others). 

*  WC  is  also  used  in  industrial  machining 
tools  and  applications. 


M993  7  62mm  Armor- piercing  cartridge 

GJobaliMtJrty  otg 


IJWCIA  SSI  TIED 
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Indentation  Hardness  Testing 
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Indentation  hardness  is  the 
measure  of  a  material's  resistance 
to  plastic  deformation. 
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Quasi-Static  Knoop  Hardness  (HK>: 

*  2kgf,  5kgf,  and  lOkgf  loads 

*  io^s-1  strain  rates 

Dynamic  Knoop  Hardness  (DHK): 
30kgf  - 1  lOkgf  load  range 

*  103  s-1  strain  rates 
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ruegom  Dynamic  Indentation  Hardness  Tester  aXUL  (OSp 


Indenter 

|  Sample  | 

Tip 

Time  (ms) 
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MATLAB  Code 


AKL  (  25) 


Analyzes  raw  strain  gage  and  load  cell  signals  to  extract  load  and  strain  rate: 

HI 

ef(t)  = 

Bridge  Factor  X  Strain  Gage  Signal 

(Eq.l) 

Excitation  Voltage  x  Gage  Factor  x  Amplifier  Gain 

V  —Cn 

E  (t)  ~  Ef(0 

(Eq.  2) 

P  —  Load  Cell  Signal  x  Charge  Amplifier 

(Eq.  3) 

£  —  Strain 

t  =  Strain  Rate  (s-1) 

HK  =  0,014229*^ 

(Eq.  4) 

d  =  Indent  Diagonal  (mm) 

dA 

V  ~  Indenter  Velocity  (m/s) 

C0— Wave  Speed  in  Rnr(m/s) 

P  =  Load  (N) 

6 
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Analyzing  Signals 


ARL  v(25')' 


Load 


Strain  Rata 
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WC  Compositions  Tested 


ARL 


*  Seven  different  com  positions  tested 

*  Variations: 

■  Binder  material 

■  Binder  percentage 

■  Grain  size 

*  Commercial  compos  itions  used  as 
benchmarks forfuture  investigations 
of  ARL  systems 


Material 

Binder 

Wt% 

Binder 

Grain  Size 
(pm) 

Cercom  WC 
Binderless 

N/A 

*0% 

0.4 

Kerma  metal  SI  05 

CO 

10% 

0.6 

MP!+  15 

Co 

15% 

1.7 

MPIt  20 

Co 

20% 

1.1 

MPIt  25 

Co 

25% 

1.5 

Kennametal  KFY 

CrNi3 

10% 

0.6 

Kennametal  BFY 

CrN  l3 

10% 

0.9 

■Now  pari  tif  COOrslek,  Gulden  CO.  {MatEMiaEK  RrOttSSAg  me 
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•  CrNi3  binders  forgo  the  traditional  Co,  which  is  being  phased  out  due  to  health  problems 
and  economic  viability. 

*  Other  Ni  and  Fe  based  binders  are  also  being  researched  as  alternatives. 


mmmm 
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BFYNiCr, 


Quasi -Static  vs.  Dynamic  Hardness  AttL 


KFY  NiCrj 


2 

■o  600 


200 


39%  Increase 


J 


DHK  =  16.6  GPa  -• 


✓ 

✓  HK  =12.0  GPa 


'  ✓ 


200 


18%  Increase 


s 


DHK 


Jt'  ' 

=  16.4  GPa  T  * 


r> 


ys 


HK  =  13.9  GPa 


0.2  0.4  0.6  OS  1 

Diagonal1  (mm1) 


0,2  0.4  06 

Diagonal*  (mm1) 


0  6 
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Trends  in  the  Data  AK.L 
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Hi 
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•  Co  Binder 

-  30% 

-  20% 

•  CrNi3  Binder 

10% 

10% 

0% 

0% 

* 

0%  5%  10%  15%  20%  25%  0  0.5  1 

1.5 

2 
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*  Cobalt  has  an  HCP  crystal  structure  with  a  low  stacking-fault  energy  (SFE)and  a  limited 
n  u  mber  of  si  i p  systems, 

*  HCP  struct u res  with  low  S FE  are  h ig h ly  suscepti ble  to  forming  twins  at  high-stra in  rates, 

*  Twi  n  bou  ndaries  act  as  barriers  to  d  islocation  motion,  i  ncreas  ing  hard  ness. 
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*  Dynamic  Knoop  hardness  is  greater  than  quasi-static  Knoop  hardness 

•  As  binder  %  and  grain  size  increase,  larger%  increase  in  dynamic  hardness. 

•  Li  near  relationship  between  q  uasi-static  hardness  and  %  increase  of  dy  namic  hardness 

*  Twinning  in  the  Co  bindera  possible  reason  for  these  trends 
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Military  Applications: 

*  Bridges  the  gap  between  laboratory  and  ballistic  performance  of  tungsten  carbides 

-  Sets  the  benchmarks  for  future  binders  and  materials  used  in  armor-piercing  rounds 

Future  Work: 

*  Further  SEM  and  TEM  investigation  of  twinning  in  HOP  crystal  structure  of  cobalt 

*  Test  different  co bait-free  WC  systems  (including  ARL-developed  materials) 

*  Investigate  deformation  mechanisms  of  alternate  binder  systems 
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Howard  Payne 


I  am  a  third-year  student  at  the  Pennsylvania  State  University  (Penn  State),  studying 
material  science  and  engineering.  Since  my  freshman  year  I  have  been  working  in 
a  laboratory  on  campus,  where  we  focused  on  binary  and  tertiary  lead-based 
piezoelectrics  under  the  advisement  of  Dr  Messing.  I  will  be  returning  to  the  CTMB 
branch  in  WMRD  next  year  for  a  spring  co-op  to  continue  my  research.  After 
graduation,  I  am  thinking  of  possibly  going  to  graduate  school  to  pursue  a  doctorate 
in  materials  or  ceramics. 
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Effect  of  B:B203  on  Reactive  Hot-Pressing 
of  Boron  Suboxide 

Howard  E.  Payne 


Kris  D.  Behler,  Lionel  R.  Vargas-Gonzalez,  William  T.  Shoulders,  and  Jerry  C.  LaSalvia 
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BLUF 


•  Boron  suboxide  is  an 
attractive  armor  ceramic 

•  Current  process  is  very  costly 
->  synthesis  powder  then 
density 

•  Combining  synthesis  and 
densification  into  a  single-step 
(“Reactive  Hot-Pressing”) 


•  Has  the  potential  to  decrease  the  cost  of 
manufacturing  dense  bodies 


•  Discovered  the  importance  of  excess 
boron  oxide  on  densification,  phase  purity, 
hardness,  and  hot-pressing  issues 
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Background 


ARL<m 


Armorapplications 
High  Hardness,  Low  density 
Current  processing  route  is  complex 
Boron  suboxide  synthesized  at  low  pressures  is  oxygen-deficient 
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•  SPS  (Spark  Plasma  Sintering) 

•  Multi-anvil 

•  Hot-pressing  with  B60  powder 

SPS 


Multi-anvil 
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•  Eliminate  independent  powder  synthesis  steps 

•  Might  be  able  to  lower  the  densification 
temperature 

•  Enhance  industrial  viability 

•  Two  less  furnace  steps  needed 

•  Less  amorphous  boron  needed,  highest  cost 
component 

•  In-house  production  at  ARL 
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16/?  +B203  — >  iB60^x 

•  Powder 

•  B203:  99.9%  Noah  Technologies 

•  B(amorphous):  92.1-96%  SB  Boron 
Corporation 

•  Massed  in  ratios  between  0-24  mass  %  excess 
Oxygen  (O)  in  reaction 

•  Mixed  on  Lab  Ram  acoustic  mixer  for  ~5  min 

•  Powders  kept  dry  in  vacuum  oven 


Powder 
(Mass  %  0) 

B203(g) 

B(g) 

Stoichiometric 

3.1565 

7.8440 

6.8%  excess  O 

4.2422 

6.7581 

10.2%  excess  O 

2.8217 

2.1786 

12.3%  excess  O 

6.9714 

8.0276 

23.7%  excess  O 

9.4668 

5.5341 

6  B  +  1/2  02  -»  16/3  B  +  1/3  B203  -»  BeO 

16B  +B203  ^B60 
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Reactive  Hot-Pressing  ARL(!(25 


Followed  typical  densification  profile  as  previous  hot-piressing 
Tested  0-24  mass  %  excess  O 
6100  Ibf  on  1-inch  Die  (~53.6  MPa)  applied  at  3h  hold 


¥ 


•  BN  coating  on  graphite  die 


Boron  Nitride 


Punch 


Temperature  Profile 


Time  (min) 


Die 


b+b2o3 

Powder 


Die 


7 


UNCLASSIFIED 


The  Nation’s  Premier  Laboratory  for  Land  Forces 


Approved  for  public  release;  distribution  is  unlimited. 


93 


UNCLASSIFIED 


m 


US  ARMY 

RDECOM 


Densification  Behavior 


ARL 


•  Monitored  the  ram  displacement  through  (Linear  Variable 
Displacement  T  ransducer)  LVDT 
•  Showing  densification  and  volatilization 


0%  excess  O 
6.8%  excess  O 
10.2%  excess  O 

12.3%  excess  O 
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Conclusion/Future  Research  ARL 


•  For  reactive  hot-pressing  a  composition  of  6.8-10.2  mass% 
excess  O  should  be  used 

•  XRD  Data 

•  Elimination  of  2nd  phase  in  microstructure 

•  Highest  hardness  and  density  values  achieved 

•  Additives  effect  on  Boron  Suboxide 


•  Hardness,  fracture  toughness,  density 

•  Will  the  thermodynamics  of  reaction  have  any  effect? 

•  Possible:  yittria,  silica,  mullite,  rare  earths,  etc. 

•  Redo  study  with  better  controlled  powder  chemistry 
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Daniel  Blackman 
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master's  degree  in  biomedical  engineering  from  Cornell  University.  His  past 
research  experiences  span  organic  chemistry,  metallurgy,  biophysics, 
biomechanics,  and  bio-inspired  robotics.  His  current  research  focuses  on  this  last 
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systems.  This  summer,  he  focused  on  the  challenges  associated  with  designing 
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TABLE  II 

Scale  factors  for  System  Variables  of  Dynamical.  Legged  Models 


Parameter 

Scale  Factor 

General  Case 

Constraint  1' 

Constraint  2; 

Constraints  I  and  2? 

Length 

<*/ 

ai. 

ai. 

«/. 

Mass 

aFat  xaTz 

Ob 

al*aTZ 

<*is 

Stiffness 

a* 

1 

<*F<*L 

aL  'aT  2 

aLl 

Damping 

<*b 

'«r 

a^a/-,/2 

a/.3°r  1 

Vi5* 

Frequency 

<*t1 

a/-,/2 

ar-‘ 

aL~Xfl 

Gravity 

cn,aT-2 

1 

aLaTz 

1 

Touch-Down  Velocity 

a* 

ot.ctr 

a/.,/2 

a/. 1/2 

Touch-Down  Heading 

<*> 

1 

1 

1 

1 

Touch-Down  Leg  Angle 

1 

1 

1 

1 

euilMLIilll  1.  UlA\\l\  K  lUtL  illlK  |>L IILtL  III  fUJ  U)  *T 


-fcm 


-*r 


Miller  &  Clark  (2015) 


Ihe  gravity  scale  factor  is  equivalent  to  the  acceleration  scale  factor,  though  it  is  not  specifically  addressed  herein. 


Parameter 

RHex 

scaled  to  Kdubot* 

Kdubot* 

Body  Length  (ml 

0.5  r 

a37 

0.36 

Leg  Length  (m) 

0. 16T 

0.115 

0.115 

7.5T 

3.2 

3.2 

tx*g  Stiffness  (Nm  1 

1900' 

1130 

960 

Speed  ( ms  ' ) 

IV 

2.29 

125 

Stride  Frequency  (s1) 

4.2 

4.95 

5.25 

Fronde  Number  (-> 

4.67 

4 

4.49 

Strouhal  Number  (  ) 

4.02 

To! 

T86 

Specific  Resistance  <  I 

0.84? 

0.84 

0.51 
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Plan  of  Action 


ARL 


1.  Design  at  the 
Scale  of  Interest 


2.  Scaling 
limitations 


3.  Controller 
Development 


4.  Controller  and  Physical 
Design  Optimization 


5.  Dynamic  Scaling 
of  Controllers 
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[Yj  rdecom  i.  Design  at  Scale:  Minitaur  ARL 
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1  Physical  Parameters 

Parameter 

Value 

Mass 

5  kg 

Length 

0.4m 

Width 

0.22m 

Max  Height 

0.3m 

Kenneally  and  Koditschek(2015) 
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•  Unique  direct-drive  system 

-  High  speed  regions 

—  Localization  of  motor  mass 

-  Mechanical  compliance 


Minitaur 
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2.  System  Limitations:  Power  Theory  ARL 


Force  Plate  Measurement  Confirms  Voltage  Calculation 


1  _ k 

0 

!  ■=> 
j 

Scaling  Motor 


-  Calculate  U10  Power:  p  = 


Rn 


Pscaled  ~  CtpP  —  ~  P  —  OLpJapP 


-  Scaled  Power: 

-  Use  U10  values  ( ke,kt,Rm)\  Vscale  =s/pscaleRm 


ktV 

Tstall  —  D 

' '  in 

V 

“NL  =  Ye 
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RDECOM  3.  Controller  Development:  Raibert 


Raibert  SLIP-based  Controller 

-  Assume  pogo  stick  motion 
(Spring  Loaded  Inverted  Pendulum) 

-  Apply  thrust  in  decompression  phase 

Modifications 

-  Stiffness  increase  by  a  factor  (2nd  half  of  stance) 

-  Touchdown  angle  modulation 

-  Hip  rotation  torque  throughout  stance 


ES*i 


At 

• 

MIT  Raibert  Hopper 


•  Raibert  SLIP-based  Controller 

-  Assume  pogo  stick  motion 
(Spring  Loaded  Inverted  Pendulum) 

-  Apply  thrust  in  decompression  phase 


•  Modifications 


-  Touchdown  angle  adjustment 

-  Energy  removal  through 
nominal  leg  length  adjustment 


fiZ  =ti°+c(PlD 


A)  —  Inom  ~  Idev  sin 
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4.  Controller  and  Physical  Design  Optimization 


5.  Dynamic  Controller  Scaling  Megataur 
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Conclusion  Summary 

ARL 

1.  Design  at  the  2.  Scaling 

Scale  of  Interest  limitations 


3.  Controller 
Development 


4.  Controller  and  Physical 
Design  Optimization 


5.  Dynamic  Scaling 
of  Controllers 
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Summer  Objective:  Determine  practical  limits  of  subpixel 
motion  detection  using  a  video  camera 

•  Introduction 

-  Motivation 

-  Experimental  Setup 

•  Signal  Processing 

-  Outline  of  Algorithm 

-  Edge  Finding 

-  Subpixel  Detection 

-  Noise  Statistics  and 
Estimation  Limits 

•  Results 

-  ROC  Curves 

-  Simulated 

-  Measured 

•  Conclusion 
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Motivation  and  Background 


•  Video  cameras  are  ubiquitous 

•  Objects  such  as  paper,  clothing, 
windows,  and  thin  walls  move  in 
response  to  sound  waves 

•  Acoustic  data  can  be  extracted 
from  video  feed  of  these  objects 

•  Many  environments  often  pose 
limitations  to  acquiring  audio 


MM  rue  AffwrtcJA  L#g»on  8rdg 

iMMn^AmencanteQionPfdg 


Montgomery  County  Traffic  Cameras 


Chang*  vwwaM*  Ridiuv  |26Mtesi»l 


•  Interest  in  analyzing  audio  spectra 
of  target  of  interest 


A.  Davis,  M.  Rubinstein,  N.  Wadhwa,  G.  Mysore,  F.  Durand,  W.  T.  Freeman,  "The  visual  microphone:  Passive  recovery  of  sound  from 
video",  ACM  Trans.  Graph.,  vol.  33,  no.  4,  pp.  79:1-79:10,  2014. 
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Experimental  Setup 


•  Conducted  in  ARL 
Anechoic  Chamber 
to  reduce  noise 

•  Measured  a  motor 
actuated  rod 

•  Collected  moving 
and  static  data 


ARL 
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Moving  Target  -  make  better 
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First  pass 


Second  pass 


(' VT-W  -V ) 

p  =  vt-w-x  ~ Polynomial 

V  —  [1  yy2  ...]  —  Vandermonde 
W  —  Weight  Array 


Image  of  rod 


Matched  filter  output 


Detected  edge 
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Polynomial  coefficients  versus  frame  # 
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Fourier  Model  Fitting 


A 

RL 

9 
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Bin  Data  by  Subpixel  Changes 


Calculate  test  statistics 


Generate  Receiver  Operating 
Characteristic  Curves 


A 

RL 

_ 10 
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Detection  Algorithms 


•  Binary  Detector 

•  I  Observations  Results  for  1=100  Pixels 


•  Hi :  No  Pixel  Shift 

•  H2:  Pixel  Shift 

Test  Statistics  -  need  work 


sum  difference 

150  - T - T - . - 


xio10 
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•  Thermal  noise  (Dark  current) 

Thermal  noise  power  =  4kTBR 
Capacitor  reset  power  =  KT/C 
additive  Gaussian 

can  be  bigger  in  blue  channel  due  to  increased  amplification 

•  Impulse  noise  (salt  and  peppernoise) 

ADC  errors 
bit  errors 

photo  diode  leakage  current  for  slow  shutter  speeds 

•  Shot  noise  -  discrete  nature  of  particles 

thermal  generation  within  a  depletion  region 
statically  quantum  fluctuations  in  number  of  photons 

Poisson  distribution  with  rms  level  proportional  to  square  root  of  image  intensity 
P(X=k)=AkeAk/k!  where  A=E(X)  =  Var(X) 
thermal  generation  within  a  depletion  region 

•  Quantization  noise 

•  Periodic  noise 

60- or  120-Hz  noise 

•  Readout  noise 

CCD:  3-8  electrons 
CMOS:  2-4  electrons 
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Cramer-Rao  Lower  Bound  for 
Estimatin^ubDixe^hif^^ 
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tti  =  ^2  /*(m  “  —  v2> 

mse(</)) 

^MT1 

a-2  =  /^(m  —  vi  >  71  ~  V2)fy(rn  —  vi,  n  —  v2) 

m,n 

m  = 

ral  a2l 
ia2  a3-l 

a3  =  ^  fy(jn  —  V! ,  n  —  v2). 

m,n 

RMSE  vs  SNR 


3 IMF*  <dD) 


D.  ROBINSON,  P  MILANFAR,  "Fundamental  Performance  Limits  in  Image  Registration",  IEEE  Trans.  Image  Process,  vol.  13, 
no.  9  dd.  1185-1199. 2004. _ 
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★FTT)  hdecom  Rod  Simulation  ARL 


Simulate  moving  rod  with  Simple 
Sinusoidal  Motion 


Convolve  images  with  simulated 
PSF  Kernel  &  add  Gaussian  Noise 


I 


Run  through  Two-Pass  Processing 
Algorithm 


Simulated  Rod 


Rod  Edge  Detection 
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Detection  Algorithm: 

-  Squared  Difference 
Number  of  Pixels: 
-25 

Number  of  Samples: 

-  10,000 

Noise: 

-  Gaussian 

-  SNR  =  37  dB 
PSF: 

-  Gaussian  Kernel 


ROC  Curves  Square  Test 
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Measured  Roc  Curves 


Detection  Algorithm: 
-  Squared  Difference 
Number  of  Pixels: 
-500 

Number  of  Samples: 

- 10,000 
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m  l*!T)  RDECOM  Conclusion 


Conclusions: 

•  Built  an  oscillating  rod  and  measured  it  in  a  controlled  low  vibration  environment 
with  a  RED  video  camera. 

•  Used  a  bank  of  match  filters  and  multipass  polynomial  interpolation  to  find  the 
moving  edge  of  the  rod. 

•  Motion  was  fit  to  a  harmonic  model  for  all  intercepts  to  bin  subpixel  shifts 

•  Achieved  subpixel  detection  down  to  1/200  of  a  pixel. 

Future  Work: 

•  Extension  of  measurements  and  processing  to  other  video  systems. 

•  Application  of  processing  to  detecting  building  vibrations  for  upcoming  field  test. 

•  Approximate  high-resolution  video  as  analog  and  apply  CRLB. 

Acknowledgements: 

•  Mr.  Goldman  and  the  ARL  Acoustics  Branch 

•  ARL,  ASEE,  &  CQL 
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Residuals  for  Slope  Fit 


xIO 


Residuals  of  Model  Fit 


-1.5 


0  200  400  600  800  1000  1200  1400 

Frames 
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Distribution  of  Pixel  Shifts 


Change  in  pixel  value  (tif  Images) 
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Maxwell  WH  Alander 


Maxwell  WH  Alander  made  the  trip  from  Missouri  to  Maryland  this  summer  after 
graduating  with  his  Master  of  Athletic  Training  degree  from  Saint  Louis  University. 
The  previous  year,  he  received  his  BS  in  Exercise  Science  from  the  same  institution. 
Originally  a  mechanical  engineering  major,  his  passion  for  physiology  and 
performance  led  him  to  change  his  focus.  Throughout  college,  he  participated  in 
Division  I  athletics,  Greek  life,  and  served  as  an  assistant  to  strength  and 
conditioning  coaches  in  the  athletics  department.  When  he  is  not  analyzing  H-reflex 
recruitment  curves,  he  can  be  found  paddle  boarding  in  the  bay  or  biking  in 
Susquehanna  State  Park.  His  future  plans  are  to  explore  opportunities  in  research 
and  sport  performance  that  would  allow  him  to  continue  contributing  to  the 
scientific  community. 
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Problem 


AKLm 


•  Soldiers  require  fine  motor  control  for  various  tasks. 
•  Marksmanship 


•  Tremor  can  result  in 
a  decrease  in  fine 
motor  control. 

•  Deviation  from 
intended  or  ideal 
movement 

•  Stress  and 
physical  exertion 

(Puschmann  et  al,  2011) 
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Introduction  AKL 


•  Vibratory  noise  stimulation  has  elicited  performance 
increases  relevant  to  Soldiers 

•  Works  by  enhancing  sensitivity  of  sensory  input, 
which  in  turn  affects  motor  output 

•  Imperceptible  vibratory  noise 

•  Decrease  tremor  (Kouzaki  et  al,  2012) 

•  Increase  agility  (Miranda,  2016) 

•  Improve  sensorimotor  performance  (Mendez-Balbuena  et  al,  2012) 

•  Enhance  postural  stability  (Ross  et  al,  2007) 
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•  Movement  is  the  product  of  the  integration  of  motor  centers 
with  sensory  information. 


•  Many  moving  parts 

•  The  aim  of  this  project  is  to 
explore  motor  adaptation  to 
imperceptible  noise  in  the  form 
of  vibration  on  the  spinal  reflex. 

•  Attempt  to  understand  short 
term  adaptation  to  the  motor 
system 
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Background 
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How  do  we  measure  changes  in  the  spinal  reflex  system? 


Tendon  tap 
(myotatic)  reflex 

Hoffman  reflex 


(Wynne  et  al,  2006) 
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H  -  reflex  recruitment  curves  are  used  to  account  for 
variability  between  participants. 

•  Series  of  stimulations  with  increasing  intensities 


Give  insight  into  how  an  individuals  unperturbed  spinal 
reflexes  operate 


H-Reflex  Recruitment  Curve 
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My  Question 
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How  does  imperceptible  vibratory 
noise  affect  the  spinal  reflex? 

Hypothesis: 

Vibratory  noise  stimulus  will  decrease  the  spinal 

reflex 

(Armstrong  et  al,  2008) 
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•  The  H  -  reflex  was  then  gathered  under  either  a 
randomized  vibratory  stimulus  condition  or  sham. 

•  Stimulated  10  times  in 
one  minute 

•  H-reflex  amplitude  under 
both  conditions  was  then 
normalized  to  the  maximal 
M-wave  for  each  subject. 
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Methods  and  Analysis  ARL 
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•  Stimulus  artifact 

•  M-wave 

•  H-wave 

•  Latency 

•  Amplitude 
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Results 

arlSIi 

•  Generalized  linear  model 

•  Accounts  for  multiple 

*P  =  0.0016 

observations  on  each 

25 

subject 

20 

•  Hypothesis  testing 

Q) 

> 

•2 

performed  via  Chi  square 

L 

test 

_  15 

re 

•  Does  not  make 

E 

X 

re 

assumptions  about  the 

5 

o  10 

distribution  of 

o 

s? 

underlying  data 

5 

•  Imperceptible  vibration 

stimulation  produced  a 

1.73%  increase  in  H-reflex 

Stimulation 

Sham 

amplitude 

Condition 

12 
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•  The  data  gathered  shows  a  small  but  statistically  significant 
increase  in  the  spinal  reflex  with  an  imperceptible  vibration 
stimulation. 

•  Results  did  not  support  my  hypothesis 

•  Spinal  reflex  plays  a  role  in  motor  adaptation  induced 
by  vibratory  stimuli 

•  Behavioral  outcomes 

•  Motor  level  matters 

•  Determines... 

•  Stimulation  time  needed  to  elicit  effects 

•  Duration  of  effects 

13 
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•  How  can  this  benefit  Soldiers  in  the  field? 

•  Potentially  increase  weapon  stability  and  control 

•  Marksmanship  task 

•  Combat  medic 

•  Load  carriage 

•  Other  applications 

•  Next  steps 

•  Analyzing  the  effects  of  noise 
stimulation  on  other  motor  centers 

•  Applying  noise  stimulation  to  real-world  tasks  Amnymi1 
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Kevin  Corder 


I  am  a  third- year  computer  science  PhD  student  at  the  University  of  Delaware  (UD), 
where  I  also  received  my  BS  in  computer  science.  I  work  under  Dr  Keith  Decker 
in  the  Multi-Agent  Systems  Lab  at  UD,  and  my  research  is  generally  in  cooperative 
multi-agent  systems.  I  have  2  conference  papers  in  review:  an  approximation 
method  for  the  Shapley  value  in  feature  games,  and  an  improved  model  for  the 
cooperative  information  gathering  problem. 

After  this  summer  project  is  completed  and  written  up,  I  plan  to  continue  working 
with  Manny  Vindiola  at  ARL  through  the  remainder  of  my  degree.  Through  a 
project  in  collaboration  with  Stanford,  I  will  study  cooperative  deep  reinforcement 
learning  and  how  its  neural  nets  may  be  implemented  on  neuromorphic  hardware. 
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•  Third-yearcomputerscience  PhD  Student 

•  University  of  Delaware 

•  Studying  Multi-agent  Systems/Distributed  Al  with 
Dr.  Keith  Decker 

•  This  is  my  10th  week  at  ARL 

•  Mentor:  Manny  Vindiola 
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About  the  Project 


ARL 


•  This  project  aims  to  efficiently  solve  a  computationally  hard 
problem — vertex  cover — on  IBM  TrueNorth,  a  highly  distributed 
and  low-power  neuromorphic  processor. 

•  Vertex  cover  can  represent  many  real-world  problems,  like  finding 
the  minimal  number  of  gateways  in  ad  hoc  or  wireless  sensor 
networks  where  expensive  solutions  may  be  infeasible. 

•  To  compute  vertex  cover,  we  use  a  distributed  Metropolis- 
Hastings  simulation  of  an  Ising  model  formulation  where  we 
converge  to  a  solution  by  lowering  over  time  the  probability  of 
exploration. 
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•  Finding  the  computational  limits  of  neuromorphic  architectures  is 
an  open  question. 

•  Our  group  previously  showed  TrueNorth  to  be  Turing  complete 
(implemented  Conway’s  Game  of  Life). 

•  Efficiently  solving  Minimum  Vertex  Cover  would  be  proof  by 
example  of  a  neuromorphic  processor  being  able  to  solve  NP- 
hard  problems. 

•  By  NPC  reducibility,  could  potentially  solve  or  provide  insights 
into  solving  many  related  hard  problems  for  future  neuromorphic 
architectures. 
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•  Ad  hoc  networks  are  dynamic,  self-adjusting  wireless  networks 
where  nodes  may  move  freely 

•  Wireless  sensor  networks:  type  of  ad  hoc  network  where  many 
small  sensors  send  data  to  a  base  station 


•  Possible  application  in  future:  finding 
minimum  number  of  data-forwarding 
nodes  with  Vertex  Cover  problem 

•  Nodes  have  an  edge  between  them  if 
they  are  within  wireless  range 

•  All  nodes  assumed  equally  good 
candidates  for  forwarding  data 

•  Data  forwarding  is  proactive/hybrid 

https://en.  w  ikipedia.org/wikiWireless_ad_hoc_nehwrk 
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Typically  multi-hop  to  minimize  communication  energy,  where  energy 
efficiency  is  a  major  challenge 
Clustering  is  common  in  practice,  or... 
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Given  an  undirected  graph  G  =  ( V,E ),  the  Vertex  Cover  problem 
(VC)  consists  of  finding  a  set  of  vertices  V'  such  that  every  edge 
has  at  least  one  endpoint  in  V' 

•  V'  is  said  to  cover  the  graph  G 


<r 


The  minimum  Vertex  Cover  problem  (MVC)  is  finding  a  vertex 
cover  V'  with  the  least  possible  number  of  nodes 
•  There  are  >  1  minimum  vertex  covers  for  any  graph  G 


https://en.wikipedia.org/wikiA/ertex_cover 
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Vertex  Cover  is  NP-hard 

ARL((2§ 

However,  computing  MVC  is  very  difficult  for 
traditional  computers. 

NP problems  can  be  computed  by  a 
nondeterministic  Turing  machine  in  polynomial 
time.  \  NP-Hard 

•  Can  be  verified  in  polynomial  time  by  computer 

NP-hard  problems  are  not  solvable  in  less  than 
exponential  time  (...  unless  P=NP).  ^  NP-Complete 

NP-complete  (NPC)  problems  are  in  both  NP  and 
NP-hard.  ,  Np 

•  Every  problem  in  NP  is  reducible  to  any  in  NPC,  so 
every  NPC  problem  is  reducible  to  every  other. 

\  P 

Vertex  Cover  Problem  is  NP-complete ;  x 

Minimum  Vertex  Cover  Problem  is  NP-hard. 

•  Our  implementation  could  solve  other  NPC 

problems  reduced  to  Vertex  Cover.  r  INr 

Vertex  Cover  may  be  efficiently  computable  on  a 

neuromorphic  architecture.  7 
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•  Several  NPC  problems  have  been  mapped  to  the  Ising  Spin  Model,  a 
model  for  ferromagnetism  from  statistical  mechanics. 

•  It  models  the  magnetic  dipole  moments  of  atomic  integer-spins  (+1  or  -1) 
and  is  used  to  identify  phase  transitions. 


Each  particle  has  a  spin  (ot)  and  interacts  with  its  neighbors. 

•  E.g.,  4  neighbors  in  a  2D  grid 

•  Loca/ updates  lead  to  g/oba/ change 

The  energy  of  the  spin  configuration  is 
given  by  the  Hamiltonian 

H(<T)  =  -YjJiJoi<Tl-nYjhi<Tj 
U  ) 

for  spin  interaction  Jt  j,  magnetic  moment p,  and 
external  field  ft,- 

Spin-site  configuration  probability  from  the 
Boltzmann  distribution  with  inverse 
temperature  /?  =  (fcBr)_1  >  0: 

e-m°) 

Pp(<T)  = 


100  200  300  400 

https://en.wikipedia.org/wiki/lsing_model 
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Ising  Spin  Model  Simulation  AKL  (2b). 


•  The  Ising  Model  has  been  simulated  on  CPU/GPU  in  2D  with  the 
Metropolis-Hastings  Monte  Carlo  algorithm  using  the 
configuration  probability  for  Boltzmann  exploration. 

•  The  simulation  stochastically  reduces  the  system’s  energy  over 
time  with  Boltzmann  exploration  of  a  simplified  Hamiltonian: 

tfO)  = 

i.j 

•  The  Metropolis-Hastings  Ising  Model  simulation  can  be 
summarized  as: 

1.  Choose  a  spin  site  k  with  probability  i  (for  N  spin  sites) 

2.  Compare  its  local  energy  contribution  to  the  energy  if  ok  were  flipped 

3.  If  new  energy  is  less,  keep  flipped  state 

4.  If  new  energy  is  more,  keep  new  state  with  probability  e~p(Hv~H^ 

5.  Repeat 


I 
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UNCLASSIFIED 


(★TO  RDECOM  ising  Model  Metropolis  Simulation^lfL 


•  This  simulation  is  slow  when  run  sequentially,  so  it  has  also  been 
adapted  for  GPU  implementations  [2]. 

•  Since  each  spin  site  only  depends  on  its  4  neighbors  (in  2D  grid), 
the  GPU  implementation  updates  all  non-adjacent  sites 
simultaneously. 

•  Done  with  a  checkerboard  decomposition  for  efficient  GPU 
implementation 

•  Decomposition  is  non-trivial  in  dimensions  >  2  and  for  non-uniform 
number  of  neighbors,  like  graph  nodes’  degrees 


UNCLASSIFIED 


US.  ARMY 

RDECOM 


Vertex  Cover  as  Ising  Model  ARL 


•  The  general  Ising  spin  model  is  NP-complete  [3]  and  a  2014  paper 
provides  mappings  of  many  NP  problems  to  Ising  model 
formulations  [1] 

•  Vertex  Cover  is  among  the  few  mappings  without  a  complete  graph 

•  State  of  node  v  is  xv  e  {0, 1}  (1  if  contained  in  vertex  cover  V',  or 
particle  has  +1  spin),  and  the  system  Hamiltonian  is  H  =  HA  +  HB 

•  Constraint  that  every  edge  has  at  least  one  colored  endpoint  is 

Ha=A  ^  (1  -  *„)(1  -  *„) 

u.veE 

•  Also  want  to  minimize  the  number  of  colored  vertices  with 

Hg  =  B  ^  xv 

V 

•  Require  that  B  <  A  so  total  energy  is  never  lowered  by  uncoloring  a 
vertex  that  ruins  the  solution 


I 
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Vertex  Cover  as  Ising  Model  ARL 


•  The  vertex  cover  Hamiltonian  can  be  rewritten  for  local  energy 
contribution  for  each  vertex  v,: 


H  =  B^xv  +  A^(  1-  *M)(1  -  xv) 

v  u,vEE 

V 

=  ^  BXi  +  ^(Xi~  !)•  ^  (^u-1) 


u:(t,u)£f 


H local 

•  Just  as  the  other  Metropolis-Hastings  simulations,  we’ll  lower  the 
temperature  overtime  to  converge  to  a  solution. 

•  Lower  environment  temperature  ->  lower  exploration  probability 

•  The  speed  of  lowering  temperature  is  a  hyperparameter:  we’ll  need  to 
find  speeds  that  result  in  global  optima  for  different  graph  sizes. 
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IBM  TrueNorth 


AHLm) 


TrueNorth:  “Brain-inspired  chip”  boasting  very  low  power  and  massively 
distributed  model  of  computation 

4096  cores,  each  with  256  neurons  and  256  axons  arranged  in  crossbar 
Neurons  spike  if  the  potential,  the  weighted  sum  of  synapses  plus  leak, 
exceeds  the  threshold  a  and  send  to  only  one  axon 
All  parameters  fixed  during  execution 
Orders  of  magnitude  slower 
than  traditional  CPUs,  but 
parallelism  can  compensate 
First  generation  of  this  chip,  ar 
neuromorphic  computing  is 
young — could  be  significant 
in  the  future 
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w 

Each  node  v  e  V  becomes  a  node  circuit  in  the  TrueNorth 
implementation  of  the  Ising  model  formulation,  each  connected  to 
other  node  circuits 


previous  group 

But  before  mapping  nodes/connections,  we  mustfirst  determine: 

1 .  Which  nodes  should  go  together  on  cores  (and  how  to  set  inter-core 
edges) 

2.  Which  nodes  can  be  updated  simultaneously  (groups  of  non-adjacent 
nodes,  similar  to  “checkerboard  decomposition”) 
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MKT)  Roecom  Implementation  Setup  ARLvCM 


1.  Which  nodes  should  go  together  on  cores? 

•  Connected  nodes  must  send/receive  spikes  to  each  others’  circuits. 

•  Since  a  neuron  can  only  send  to  1  axon  on  1  core,  where  all  neurons  on 
that  core  can  read  its  spikes,  more  intercore  edges  wastes  space. 

>  Want  the  most  connected  subgraphs  to  share  the  same  core 

•  This  becomes  a  graph  partitioning  problem  to  find  the  minimum  cut  of 
the  graph  (find  least  number  of  edges  to  bisect  graph). 

•  Another  NP-hard  problem! 

•  We  use  spectral  bisection,  a  greedy  solution,  for 
time  efficiency  at  the  expense  of  non-optimal 
space. 

•  Bisected  graph  may  not  fit  on  a  core,  so  we 
recursively  partition  each  subgraph  until  it  does. 


\ 


* 

A  minimum  cut. 

https://en.wi  kipedia.org/wiki/Cut_(graph_theory) 
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Implementation  Setup  ARL 


2.  Which  nodes  can  be  updated  simultaneously? 


•  Need  groups  of  non-adjacent  nodes,  like  the  “checkerboard 
decomposition”  for  the  2D  Ising  model  simulation. 

•  Each  node  v  may  update  concurrently  with  each  non-adjacent  node 

u  e  V :  (u,  v)  g  E. 

•  This  is  a  graph  coloring  problem:  find  the  minimum  number  of  colors 
needed  to  assign  every  node  v  e  V  a  color  such  that  no  2  adjacent  nodes 
have  the  same  color. 


•  Also  NP-hard!  Again,  we  use  a  greedy  solution. 

•  The  nodes  assigned  the  same  color  becomes 
group  of  nodes  that  may  be  updated 
simultaneously. 

•  Nodes’  circuits  will  be  activated  by  a  group 
clock  neuron  according  to  their  graph 
coloring  result. 


https:.' >en  .wikipedia.org/wiki'Graph  coloring 
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Node  Circuit  Details  AKL  2gj) 
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Node  Circuit  Details 


ARL 


•  Number  of  sent  probability  spikes  is  equal  to  maximum  graph  degree  dmax  +  1 

•  Off-chip  probabilities:  p0  <  Pi  <  —  <  Pdmax-i  =  Pdmax 

•  PN  determines  if  probability  spikes  are  sufficient  for  current  neuron 

•  A  neuron’s  probability  is  padj+  =>  PN  spikes  if  #  of  prob.  spikes  >  adj+  20 
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Node  Circuit  Details 
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Results 


ARL 


Implementation  is  underway! 

•  Currently  unit  testing  components,  testing  them  together  after 

Timeline  in  weeks: 

•  1-2:  learned  about  TrueNorth  architecture  and  corelet  programming 

•  3:  learned  about  Ising  models  and  their  simulations 

•  4:  wrote  TrueNorth  corelet  for  2D  Ising  simulation  until  determined  feasible 

•  5:  Found  mappings  of  NP  problems  to  Ising;  chose  Vertex  Cover 

•  6-9:  Designing  the  TrueNorth  Ising  simulation  for  Vertex  Cover 

•  10:  Started  implementing  pieces  for  small  graphs 

After  implemented,  we  will  test  the  solution  quality  vs.  the  speed  of 
lowering  environment  temperature  for  various  graphs  to  learn  a  good 
boundary  dependent  on  graph  degree. 

For  various  graphs,  we  will  then  compare  solution  quality,  runtime,  and 
power  consumption  of  our  implementation  against: 

•  CPU/GPU  Ising  simulations  solving  Vertex  Cover 

•  Greedy,  polynomial  solutions 

•  Exact  solution  (exponential-time  ground  truth) 
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•  Hardware: 

•  Probabilities  need  to  be  computed  off-chip  (can’t  adjust  parameters 
to  affect  probability  dynamically). 

•  Adding/removing  graph  nodes  or  edges  requires  reinitializing 
because  of  fixed  connection. 

•  Graphs  with  large  degree  may  not  fit  on  the  chip  to  solve  at  all. 

•  Method: 

•  Takes  unknown  number  of  iterations  of  lowering  system  temperature 
to  converge,  and  may  not  find  global  optima  if  lowered  too  quickly 
(but  guaranteed  with  enough  time). 

>  Need  to  learn  this  hyperparameter  with  trials 


24 


UNCLASSIFIED 

The  Nation’s  Premier  Laboratory  for  Land  Forces 

UNCLASSIFIED 

kdecom 

U  S  ARMY 

Conclusion  &  Future  Work  AHL |2>)| 

•  In  this  project,  we’ve  detailed  a  simulation  to  solve  the  NP-hard 
Vertex  Cover  problem  on  a  neuromorphic  processor,  which  could 
have  significant  impacton  future  neuromorphic  algorithms  for 
solving  hard  problems. 

•  This  could  be  used  in  situations  like  ad  hoc  wireless  sensor 
networks  on  the  battlefield,  where  a  minimal  number  of  gateways 
may  need  to  be  computed  frequently  and  with  low  power. 

•  To  improve  this  project,  could  increase  efficiency  by  reusing 
probability  axons  between  update  groups. 

•  We  want  to  reduce  to  Vertex  Cover  a  different  NPC  problem 
(perhaps  Set  Cover)  and  see  quality  of  results  for  NPC  problems, 
in  general. 
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Matt  Mansell 


I  am  originally  from  Birmingham,  Alabama.  I  obtained  my  bachelor’s  degree  in 
chemical  engineering  and  mathematics  from  Vanderbilt  University.  For  several 
years,  I  worked  for  NASA  as  a  Life  Support  Systems  Development  Engineer  at  the 
Marshall  Space  Flight  Center  in  Huntsville,  Alabama.  I  am  now  a  full-time  graduate 
student  entering  my  third  year  at  North  Carolina  State  University  (NCSU),  where  I 
am  advised  by  Profs  Keith  Gubbins  and  Erik  Santiso.  At  NCSU,  I  use  theory  and 
simulations  at  the  quantum  and  atomistic  scale  to  study  fluids  in  extreme 
confinement.  My  future  plans  are  to  complete  my  PhD,  and  then  continue  pursuing 
my  passion  for  molecular  simulation  and  theories  of  fluids,  as  well  as  my  passion 
for  teaching  and  communicating  science,  either  as  a  professor  or  at  a  US 
government  laboratory. 
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Professional 

-  BE  in  Chemical  Eng  and  Math  (Vanderbilt  University) 

-  NASA  Marshall  Space  Flight  Center  (Huntsville,  AL) 

-  NC  State  University,  Dept,  of  Chemical  &  Biomolecular  Engineering 

•  Academic  advisors:  Keith  Gubbins,  Erik  Santiso 

•  Topics:  Molecular  theory  of  fluids,  quantum/DFT/atomistic 
simulation 


Personal 

-  I  got  married!  2017-06-24,  Durham,  NC 
Future  Plans 


NC  STATE  UNIVERSITY 


-  Continue  working  in  theory/simulation  of 
fluids  and  interfaces,  ideally  in  an 
academic  setting  or  government  lab 
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Hot  Spot  Simulation:  Void  Collapse 
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Representing  Every  Atom  Explicitly  is  Not  Feasible 


Initial  #  RDX 

Molecules 

#  of 

Processor 

Cores 

Explicit  Atom 
Simulation  Time 
(Estimated) 

DPD 

Simulation 

Time 

20,452,820 

10,368 

7.3  years 

3.75  hours 

126,259,367 

63,232 

7.4  years 

4.34  hours 

1,126,926,339 

564,480 

7.4  years 

5.59  hours 

Simulations  used  the  same  time  step  size  and  total  time. 

‘Simulations  ran  on  the  Trinity  KNL  (Phase  2)  supercomputer,  located  at  Los  Alamos  National  Laboratory 
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RDX  Decomposition 


RDX 


|  decomposition 


> 


Product  Gas  Mixture 
(HCN,NO2,NO,H20,N2,H2,CO,CO2) 


Reduced  Reaction  Model 


*Kinetic  model  reduction  performed  by  Igor  Schweigert  at  NRL 


‘Arrhenius  Form 


COARSE-G RAINING  OF  CHEMICALLY  REACTING  SYSTEMS: 
✓  BIG  CHALLENGES 

✓  BIG  POTENTIAL  REWARDS 
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Dissipative  Particle  Dynamics  with  Reactions  (DPD-RX) 


ARL 


Equation 
of  State 


1-Fluid 


Product  \  ** 
Gas(PG) 


1 -Fluid 
Approximation  Mo,ecu,e 
(Hypothetical) 


^Composite  DPD 
^  particle 


-  Internal  State 

Density 

Temperature 

Composition 
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Interparticle  Forces 

Conservative 

Stochastic 


Frictional 
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Motivation 

Deficiencies  of  the  current  Product  Gas  Model  (PGM): 

1 .  crystallization/ordering  PG  structure 

2.  thermodynamic  properties  off  by  20-50%  or  more 

3.  ad-hoc  scaling 


Hypothesis 

A  new  PGM  will  be  more  accurate  and  versatile,  and  at  least  as 
computationally  efficient  as  the  current  PG  Model. 
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My  Contributions 


ARLgm 


MBDPD  Program 


Product  Gas  Model: 

Q(n)  =  0 


First  Guess: 
Ho  =  0.1 


Root-Finding 

Procedure 


Secant 


Calling  routine 


P  U  F 
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Exponential-6  Potential: 


=  - 


6e*(  I  -r/r. 


-’-©I 


(7) 


Equation  of  State  fora  Fluid  Composed  of 
_ Exponential-6  Particles _ 


Q(n) 


4  2V  (1/2  +  2//  +  2T,3)  +i-ZL  =  0 


(t  -  »ir 


8ii  NkT 


(16) 


NkT 


£.,+2Mw 

NkT  a  -  6 


'l/^o  r72e«G'(a;-i )  +  (oa‘/2)  jf  °°  G(/)/4  df 
J”  G(,)t*dt 


(12)- 

(14). 


/  =  (rjd)  =  (ne/>l)'/3,  >1e  =  ^P'f/6  (8) 

Sun,  J.,  Wu,  Q.,  Cai,L.  &  Jing,  F.  Chemical  Physics  Letters  449,  72-76(2007). 
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Pressure  Trajectory 
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•  Advancing  a  very  new  and  promising  field:  coarse-graining  of 
chemically  reacting  systems 

•  Performance  permitted  simulations  MUCH  faster  than  explicit 
molecule  simulation 

•  Potential  application  to  other  materials 


Better,  larger-scale  models  = 
improved  understanding  of 
microstructure  effects  =  . . . 

-  Less  risk 

-  Less  cost 

-  Higher  quality 

-  SAFER  SOLDIERS 


Skidmore,  C.B  ,  Phillips,  D  S  ,  Howe,  PM,  Mang, 
J.T.,  and  Romero,  J.A.,  11th  International  Detonation 
Symposium,  Snowmass  Village,  Colorado,  pp.  556. 
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Ongoing  Work 


•  Continue  development,  debugging,  integration,  and  demonstration  of  the 
new  PGM 

•  Computational  cost  comparisons 

•  Complete  planned  table  of  simulations 


Future  Work 

•  Publication  in  progress 

•  Integration  into  LAMMPS  software  (widely  used  particle  simulator) 

•  Integration  into/Demonstration  of  reactive  models 


Experience  Gained  So  Far 

•  Excalibur/HPC  •  Git 

•  Parallelization  (OpenMP)  •  Code  profiling/optimization 

•  Batch  schedulers  (PBS)  ♦  Dakota 

•  Fortran  •  Engility  (Tim  Mattox,  Mike  Lasinski) 

•  Python 
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Tiffany  Raber 


Tiffany  Raber  is  a  graduate  of  the  Biomedical  Visualization  Graduate  Program 
(BVIS)  at  the  University  of  Illinois  at  Chicago,  having  received  her  master’s  degree 
in  2017.  As  a  student.  Tiffany  grew  interested  in  interactive  medical 
education/simulation  techniques,  with  a  specific  focus  in  Unity  development  and 
3D  asset  creation  in  the  AR/VR  space.  She  believes  that  the  advancement  of 
MedVR  will  directly  impact  the  field,  improving  patient  experience,  surgical 
training,  science  education,  and  user  health.  Currently,  Tiffany  is  a  Visiting 
Research  Assistant,  working  in  modeling  and  simulation  in  VR,  at  The  US  Army 
Research  Laboratory  West,  located  at  the  University  of  Southern  California’s 
Institute  for  Creative  Technologies. 


UNCLASSIFIED 


Visualization  of  Human  Vulnerability  in 
Virtual  Reality 

Tiffany  Raber-  ARL  West,  ICT  2017  Summer  Internship 

Mentors:  Autumn  Kulaga,  Timothy  Myers,  Lee  Butler 
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Project  Description 
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Background 


This  research  explored  methods  for  displaying  Operational  Requirements 
Casualty-based  Assessment  (ORCA)  model  output  in  an  immersive  and  interactive 
environment.  We  used  virtual  reality  (VR)  to  explore  the  use  case  of  a  multimodal 
analysis  tool  to  help  understand  shot  trajectory  tracing,  output  of  injury  code,  and 
tissue  type/name  for  DoD  analyst  evaluation  of  human  system-level  survivability 
and  lethality  studies. 
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MW  ""tcoM  Background  AuL  m I 


ORCA  Methodology  Allows  For: 

•  Discrete  shot  lines  through 
anatomy  based  on  orientation 
of  threat  trajectory  to 
personnel 

•  Projectile  penetration 
mechanics  through 
various  anatomical 
structures 

•  Velocity  retardation  of 
threat  through  wound  track 

•  Injury  description  by  type, 
severity,  and  frequency 

•  In-depth  description  of 
operational  effectiveness 
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Background 


ARLm) 


Personnel  Inputs-  Injury  (AIS/MAIS) 

•  ORCA  utilizes  the  Abbreviated  Injury  Scale.  AIS  is  an  anatomically  based, 
consensus-derived,  international  severity  scoring  system  that  classifies  each 
injury  by  body  region  according  to  its  relative  importance  on  a  6-point  ordinal 
scale 

•  MAIS  -  Maximum  Abbreviate  Injury  Score 


Severity 

Injury  Level 

Example 

1 

Minor 

Bruise 

2 

Moderate 

Major  Laceration  /  Simple 

Fracture 

3 

Serious 

Femur  Fracture 

4 

Severe 

Serious  Brain  Injury 

5 

Critical 

Cardiac  Perforation 

6 

Maximal 

Decapitation 

9 

Unknown 

Only  Region  /  Tissue  Noted 
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Visual  Anatomical  Injury  Descriptor-  (Visual  AID) 


A  web-based  graphics  tool  enabling  individuals  to  illustrate  injury  onto  an 
anatomical  figure  and  perform  discovery  operations  by  inspecting  injury  patterns 
using  composite  information 


•  Liver;  laceration; 

Rib  Cage;  fracture(s);  Right  and  Left 
Vertebrae  C5,  C6,  C7  Fractures 
Femur  fracture;  open;  Left 
Sternum;  fracture  [OIS  II,  III] 
q  Femoral  nerve;  Left 
%  Cerebral  Concussion; 

•  Carpal  [wrist]  joint;  Right 
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Why  VR?! 


^  -MS- 
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Methodology 
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Data  Visualization/Geometry  Optimization 


Single  Shot  Nod* 

Client  ID:  Default  Single  SN>t  Pen. 

•  Man  (grain*):  16.661 

■  Striking  Velocity  (i/iec);  3*4.666 

•  Oentlty  (grani/cc):  7.666 

■  Shape  factor  <dl»en»lonle»»):  1.S66 

•  Material:  Steel 

■  Effective  Diaaeter  (—):  7.6SJ 


Shotline  Origin  (an): 
Azinvth  (degree*): 
Elevation  (degrees): 


►  215. oee  1612.64 


2  61  26.661 

2  62  26.664 

2  61  26.661 

2  62  26.664 

)  62  25.664 


S00  VOLUME  VELOCITY 


666  276.421 
666  276.421 
666  276.421 

276.421 
2S6.426 
2S9.42B 
166  256.426 
169  2S9.42B 
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Trajectory  Visualization 

Penetration  plot  of  tissue  damage  from  1 .6.0  gr  steel  cube  and  corresponding  shot  line 
geometry  representing  depth  and  diameter  of  tissue  damage: 
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Interactive  Virtual  Reality  Example- Teleportation 


12 


ORCA  vs.  Visual  AID 
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User  Interface 
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A_  mPi  as. army  "  _  _ _ 

ttl  W  ROECOM  Potential  Future  Work  /4KL  ®)| 

[[■*M«wj^ _ V«S— -^-y 


•  User  Note  Taking/Image  Saving 

•  Custom  data  importing 

•  Clipping  plane 

•  Wound-track  animation 

•  Co-operative  design  mode 

•  Population  of  models  (  anthropometries  &  postured) 

•  Context  relevant  environments  (vehicle  systems) 
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